-- Logs begin at Thu 2022-07-28 16:47:53 UTC, end at Thu 2022-07-28 18:24:44 UTC. -- Jul 28 17:46:23.542744 dv-cinder-846173-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 17:46:23.550064 dv-cinder-846173-4-smb devstack@keystone.service[80513]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 17:46:23.552087 dv-cinder-846173-4-smb devstack@keystone.service[80513]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 17:46:23 2022] *** Jul 28 17:46:23.552087 dv-cinder-846173-4-smb devstack@keystone.service[80513]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 17:46:23.552087 dv-cinder-846173-4-smb devstack@keystone.service[80513]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 17:46:23.552087 dv-cinder-846173-4-smb devstack@keystone.service[80513]: nodename: dv-cinder-846173-4-smb Jul 28 17:46:23.552087 dv-cinder-846173-4-smb devstack@keystone.service[80513]: machine: x86_64 Jul 28 17:46:23.552087 dv-cinder-846173-4-smb devstack@keystone.service[80513]: clock source: unix Jul 28 17:46:23.552087 dv-cinder-846173-4-smb devstack@keystone.service[80513]: pcre jit disabled Jul 28 17:46:23.552087 dv-cinder-846173-4-smb devstack@keystone.service[80513]: detected number of CPU cores: 4 Jul 28 17:46:23.552624 dv-cinder-846173-4-smb devstack@keystone.service[80513]: current working directory: / Jul 28 17:46:23.552624 dv-cinder-846173-4-smb devstack@keystone.service[80513]: detected binary path: /usr/bin/uwsgi-core Jul 28 17:46:23.552624 dv-cinder-846173-4-smb devstack@keystone.service[80513]: your processes number limit is 47680 Jul 28 17:46:23.552624 dv-cinder-846173-4-smb devstack@keystone.service[80513]: your memory page size is 4096 bytes Jul 28 17:46:23.552624 dv-cinder-846173-4-smb devstack@keystone.service[80513]: detected max file descriptor number: 2048 Jul 28 17:46:23.552624 dv-cinder-846173-4-smb devstack@keystone.service[80513]: lock engine: pthread robust mutexes Jul 28 17:46:23.552624 dv-cinder-846173-4-smb devstack@keystone.service[80513]: thunder lock: enabled Jul 28 17:46:23.552624 dv-cinder-846173-4-smb devstack@keystone.service[80513]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 17:46:23.552624 dv-cinder-846173-4-smb devstack@keystone.service[80513]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 17:46:23.593298 dv-cinder-846173-4-smb devstack@keystone.service[80513]: Python main interpreter initialized at 0x55aa33b799c0 Jul 28 17:46:23.593298 dv-cinder-846173-4-smb devstack@keystone.service[80513]: python threads support enabled Jul 28 17:46:23.593298 dv-cinder-846173-4-smb devstack@keystone.service[80513]: your server socket listen backlog is limited to 100 connections Jul 28 17:46:23.593298 dv-cinder-846173-4-smb devstack@keystone.service[80513]: your mercy for graceful operations on workers is 90 seconds Jul 28 17:46:23.593688 dv-cinder-846173-4-smb devstack@keystone.service[80513]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 17:46:23.593765 dv-cinder-846173-4-smb devstack@keystone.service[80513]: *** Operational MODE: preforking *** Jul 28 17:46:23.594020 dv-cinder-846173-4-smb devstack@keystone.service[80513]: *** uWSGI is running in multiple interpreter mode *** Jul 28 17:46:23.594020 dv-cinder-846173-4-smb devstack@keystone.service[80513]: spawned uWSGI master process (pid: 80513) Jul 28 17:46:23.594221 dv-cinder-846173-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 17:46:23.595307 dv-cinder-846173-4-smb devstack@keystone.service[80513]: spawned uWSGI worker 1 (pid: 80524, cores: 1) Jul 28 17:46:23.595307 dv-cinder-846173-4-smb devstack@keystone.service[80513]: spawned uWSGI worker 2 (pid: 80525, cores: 1) Jul 28 17:46:23.595307 dv-cinder-846173-4-smb devstack@keystone.service[80513]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 17:46:29.165958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:46:29.165958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: from cryptography.utils import int_from_bytes Jul 28 17:46:29.166746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:46:29.166746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: from cryptography.utils import int_from_bytes Jul 28 17:46:29.176837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:46:29.176837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: from cryptography.utils import int_from_bytes Jul 28 17:46:29.177354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:46:29.177354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: from cryptography.utils import int_from_bytes Jul 28 17:46:29.217565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:46:29.217920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:46:29.219181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] command line args: [] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:46:29.219469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:46:29.219650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ================================================================================ {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:46:29.219914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] admin_token = **** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.220164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] config_dir = [] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.220354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.220538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] config_source = [] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.220720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] debug = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.226883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.226883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.226883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.226883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.226883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.226883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] list_limit = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.226883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] log_config_append = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] log_dir = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] log_file = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.227892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:46:29.227959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:46:29.228087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] command line args: [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:46:29.228221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:46:29.228345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ================================================================================ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:46:29.228458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] admin_token = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config_dir = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config_source = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.228986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] debug = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] publish_errors = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_config_append = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.229945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_dir = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230063 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] standard_threads = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] use_journal = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] use_json = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] use_stderr = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.230923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] use_syslog = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.231306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.231449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.231577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.231745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.231863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.231926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.231926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.232116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.232175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.232175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.232288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.232288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] publish_errors = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.232403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.232465 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.232528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.232585 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.232652 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.232716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.232774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.232861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.232930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.232995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.233099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.233226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] standard_threads = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.233349 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.233447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.233585 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.233681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.233759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.233821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.233924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_journal = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.234081 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.234168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_json = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.234261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_stderr = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.234376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.234453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_syslog = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.234557 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.234702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:46:29.234846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.234979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.235115 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.235249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.235374 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.235500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.235629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.235757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.235891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.236015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.236145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.236277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.236402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.236542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.236746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.237402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.237539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.237670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.237803 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.237884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.237972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238128 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.238871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.239024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.239104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.239262 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.239341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.239498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.239584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.239730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.239809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.239964 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.240089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.240196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.240332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.240430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.240509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.240667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.240805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.240944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.241037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.241177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.241261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.241404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.241482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.241635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.241750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.241854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.241959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.242093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.242205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.242336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.242449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.242549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.242639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.242782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.242860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.243015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.243093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.243254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.243340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.243487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.243564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.243721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.243799 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.243950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.244028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.244185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.244264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.244418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.244496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.244644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.244725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.244898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.244985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.245129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.245216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.245360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.245440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.245594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.245673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.245843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.245930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.246073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.246167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.246307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.246420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.246536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.246618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.246769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.246855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.247001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.247082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.247244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.247324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.247472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.247553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.247706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.247785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.247936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.248020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.248171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.248252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.248406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.248484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.248637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.248715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.248929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.249007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.249126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.249205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.249362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.249440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.249599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.249690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.249836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.249916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.250095 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.250182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.250331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.250412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.250561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.250642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.250794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.250875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.251028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.251107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.251264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.251343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.251501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.251579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.251737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.251815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.251970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.252050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.252201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.252277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.252454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.252532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.253244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.253329 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.253480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.253560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.253726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.253925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.254987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.255142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.255230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.255375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.255454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] auth.external = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.255624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.255701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.255864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.255950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.256104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.256183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.256339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.256424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] auth.password = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.256574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] auth.token = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.256661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.256824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.256907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.257062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.257141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.257298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.257389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.257527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.257610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.257772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.257901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] credential.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.258993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.259151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.259234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.259385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.259465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.259628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.259714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.259865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.259946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.260121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.260204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.260355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.external = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.260443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.260584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.260666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.260861 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.260944 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.261120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.261211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.261350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.password = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.261430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.261579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.token = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.261708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.261807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.261891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.262056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.262143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.262268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.262350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] federation.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.262496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.262653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.262731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.262803 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.262971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.263107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.263185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.263263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.263419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.263500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.263663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.263744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.263908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.263997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.264152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.264247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.264386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.264472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.264629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.264717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.264887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.264969 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.265148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.265228 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.265398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.265488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.265632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.265710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.265875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.265953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.266114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.266205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.266364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.266444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.266599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.266679 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.266839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.266920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.267091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.267244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.267328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.267401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.267558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.267640 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.267788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.267866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.268023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.268103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.268294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.268375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.268540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.268618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.268775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.268891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.269052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.269134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.269288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.269370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.269543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.269623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.269778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.269859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.270015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.270093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.270249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.270329 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.270488 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.270569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.270720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.270799 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.270955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.271033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.271191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.271278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.271427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.271505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.271656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.271734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.271893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.271975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.272139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.272216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.272385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.272473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.272617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.272698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.272869 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.272963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.273102 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.273182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.273344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.273426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.273580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.273658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.273814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.273899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.274054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.274191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.274289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.274369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.274532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.274612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.274771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.274852 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.275003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.275082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.275234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.275313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.275471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.275552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.275703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.275782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.275932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.276010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.276167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.276253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.276403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.276483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.276638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.276715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.276896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.276989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.277134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.277222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.277367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.277456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.277597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.277677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.277841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.277921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.278072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.278158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.278299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.278377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.278532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.278611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.278762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.278849 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.278997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.279077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.279227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.279304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.279463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.279558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.279694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.279773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.279929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.280011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.280161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.280249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.280405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.280484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.280635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.280714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.280887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.280983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.281135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.281256 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.281378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.281508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.281611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.281745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.281847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.281996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.282075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.282239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.282334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.282477 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.282560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.282717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.282797 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.282956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.283036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.283203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.283284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.283445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.283524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.283706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.283786 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.283939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.284020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.284170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.284249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.284403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.284483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.284636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.284717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.284891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.284972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.285121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.285199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.285350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.285427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.285595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.285679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.285826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.285904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.286065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.286146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.286304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.286382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] resource.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.286533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.286612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.286776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.286858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.287012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.287092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.287247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.287327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.287481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.287563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.287715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.287845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288068 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] role.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.288992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] role.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.289154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.289234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.289388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.289468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.289622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.289703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.289856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.289936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.290104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.290211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.290351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.290454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.290596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.290676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.290841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.290933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.291088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.291168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.291320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.291400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.291565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.291653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.291810 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.291890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.292055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.292135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.292302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.292389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.292560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.292699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.292866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.297718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.297840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.297955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.298931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.299004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.299075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.299147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.299219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.299809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.299891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.299964 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.300942 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] token.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.301991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302507 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302873 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.302947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.connection = **** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.303977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.304971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305274 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305488 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305713 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.305936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:46:29.306668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306816 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.306995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.307235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.307468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.307702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.307935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.308168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.308410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.308643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.309159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.309392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.309637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.309870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.310114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.310344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.310581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.310814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:46:29.310981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:46:29.336048 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.336322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.336480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.336769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.338085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.338085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.344912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.345475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.375053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.378500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.378640 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.378729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.430569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.430956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.480664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.480915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.482146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.482437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.545782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.546007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.546227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.546445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.546660 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.546871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.549475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.550212 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.550436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.550654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.550863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.551071 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.570688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.570840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.570913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.570991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.571118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.571224 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.571333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.571511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.571593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.571732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.571814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.571935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.572024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.572144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.583321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.583557 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.615705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.615931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.616161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.616388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.616609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.616709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.616851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.616936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.617071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.617154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.617288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.617504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.617717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.617928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 17:46:29.639492 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.639668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.639779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:46:29.639861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:46:29.640011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.640200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.640284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:46:29.640400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 17:46:29.640493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.640671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.640753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.640967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.641056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.641219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.641300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.641472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.650893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.651167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.651413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.651514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.651692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.651776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.651962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.652244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.658603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.659759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.663882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.664157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.664432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.664530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.664704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.664808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.665001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.665083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.665275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.665484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.665579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.665655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.665767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.665913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.666029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.666183 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.666290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.666457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.666540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.666726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.666998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.667264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.690272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.691321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.691710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.691984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.692855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.693137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.696586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.696889 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.697168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.697834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.698116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.698398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.703725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.704003 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.705100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.705382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.709336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.709621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.709906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.710179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.710261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.710454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.710537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.710735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.710826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.711000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.711140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.711269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.711441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.711716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.712025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.712268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.727632 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.727899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.728847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.729127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.731806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.733170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.734955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.735243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.736288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.736583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.740155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.741589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.743330 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.744951 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.746525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.746819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.747098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.747392 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.747666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.747947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.748188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.748489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.748773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.749097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.749386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.749673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.764324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.764600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.764882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.765139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.766377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.766662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.766930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.767202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.772508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.774066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.774339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.774794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.776352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.776639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.777151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.777426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.777707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.777982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.778267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.779505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.779787 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.780080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.780364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.780656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.789655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.789928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.790200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.790475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.790753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.791023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.791298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.792345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.792629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.792946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.793232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.793515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.793791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.794074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.806890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.810040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.810133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.813048 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.813132 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.816194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.816668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.817814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.818082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.818355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.819264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.820899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.821181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.821461 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.824776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.826393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.828021 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.829310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.829591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.829732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.829869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.830138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.833314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.833602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.833886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.834163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.838698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.838976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.839259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.842323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.842610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.846525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.846608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.846608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.846728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.846937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.847207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.847482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.847752 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.848014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.848377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.848659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.848972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.849234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.849503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.849757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.849903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 17:46:29.850185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.850466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.850753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.851038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.851311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.851630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.851908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.852363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.852664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.852972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.853255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.853524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.853788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 17:46:29.884232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aa33b799c0 pid: 80525 (default app) Jul 28 17:46:29.887599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e599-1016-4825-9ced-9a35e04a66df None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:29.887887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e599-1016-4825-9ced-9a35e04a66df None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:29.888158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e599-1016-4825-9ced-9a35e04a66df None None] PATH_INFO: `/v3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:29.888535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aa33b799c0 pid: 80524 (default app) Jul 28 17:46:29.892433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Thu Jul 28 17:46:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:38.692048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7749d-d719-4d03-957b-c2c4b8907d2c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:38.692557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7749d-d719-4d03-957b-c2c4b8907d2c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:38.692643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7749d-d719-4d03-957b-c2c4b8907d2c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:38.698099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:38.703526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:38.703953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:38.704047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:38.775053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: INFO dbcounter [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] Registered counter for database keystone Jul 28 17:46:38.795987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG oslo_db.sqlalchemy.engines [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:46:38.802286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writer thread running {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:46:38.980263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG passlib.handlers.bcrypt [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80525) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 17:46:38.980601 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG passlib.handlers.bcrypt [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80525) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 17:46:39.035374 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:39.036996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:39.160701 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 17:46:39.287224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7749d-d719-4d03-957b-c2c4b8907d2c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:39.358571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: INFO dbcounter [None req-fae7749d-d719-4d03-957b-c2c4b8907d2c None None] Registered counter for database keystone Jul 28 17:46:39.377860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG oslo_db.sqlalchemy.engines [None req-fae7749d-d719-4d03-957b-c2c4b8907d2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:46:39.385554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writer thread running {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:46:39.510331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7749d-d719-4d03-957b-c2c4b8907d2c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:39.514611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098c995-e3eb-4dfb-9deb-14adc0e36f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:39.515243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098c995-e3eb-4dfb-9deb-14adc0e36f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:39.515528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098c995-e3eb-4dfb-9deb-14adc0e36f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:39.515804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098c995-e3eb-4dfb-9deb-14adc0e36f3f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:39.523867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098c995-e3eb-4dfb-9deb-14adc0e36f3f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:39.575907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8098c995-e3eb-4dfb-9deb-14adc0e36f3f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 17:46:39.576201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098c995-e3eb-4dfb-9deb-14adc0e36f3f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:39.585796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Jul 28 17:46:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 17:46:39.591744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:39.606551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18babdb-09d5-4bbc-8219-f981bf8dd295 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:39.610989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed7083-1ee3-4c21-b08e-89afcba795ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:39.612647 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed7083-1ee3-4c21-b08e-89afcba795ab admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:39.612969 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed7083-1ee3-4c21-b08e-89afcba795ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:39.613246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed7083-1ee3-4c21-b08e-89afcba795ab admin admin] PATH_INFO: `/v3/projects/a97b72a2b1b942bf9e2176dec834c175` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:39.614727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed7083-1ee3-4c21-b08e-89afcba795ab admin admin] RBAC: Authorizing `identity:get_project(project_id=a97b72a2b1b942bf9e2176dec834c175)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:39.665293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b4ed7083-1ee3-4c21-b08e-89afcba795ab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 17:46:39.665633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed7083-1ee3-4c21-b08e-89afcba795ab admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:39.670256 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Jul 28 17:46:39 2022] GET /identity/v3/projects/a97b72a2b1b942bf9e2176dec834c175 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:41.636873 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a50e9-01d9-4067-80c5-ac71954f3cfd None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:41.637356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a50e9-01d9-4067-80c5-ac71954f3cfd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:41.637356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a50e9-01d9-4067-80c5-ac71954f3cfd None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:41.641565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:41.646951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d968-223c-4d38-be2c-f1c3241f6eac None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:41.647324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d968-223c-4d38-be2c-f1c3241f6eac None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:41.647501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d968-223c-4d38-be2c-f1c3241f6eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:41.667789 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-36a0d968-223c-4d38-be2c-f1c3241f6eac None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:41.669350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-36a0d968-223c-4d38-be2c-f1c3241f6eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:41.677820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 17:46:41.699662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a50e9-01d9-4067-80c5-ac71954f3cfd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:41.711967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a50e9-01d9-4067-80c5-ac71954f3cfd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:41.716027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856caa2-7955-479d-9768-169fbb68d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:41.716622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856caa2-7955-479d-9768-169fbb68d0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:41.716933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856caa2-7955-479d-9768-169fbb68d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:41.717206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856caa2-7955-479d-9768-169fbb68d0c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:41.724683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856caa2-7955-479d-9768-169fbb68d0c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:41.726470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856caa2-7955-479d-9768-169fbb68d0c8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:41.734991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Jul 28 17:46:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 17:46:41.740033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d968-223c-4d38-be2c-f1c3241f6eac None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:41.748946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d968-223c-4d38-be2c-f1c3241f6eac None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:41.753822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f0bd3-3468-40b6-8213-04b1184f6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:41.754441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f0bd3-3468-40b6-8213-04b1184f6f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:41.754721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f0bd3-3468-40b6-8213-04b1184f6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:41.754993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f0bd3-3468-40b6-8213-04b1184f6f2e admin admin] PATH_INFO: `/v3/users/c4cff41da8b84a87883a6878ed4555c6` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:41.756353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f0bd3-3468-40b6-8213-04b1184f6f2e admin admin] RBAC: Authorizing `identity:get_user(user_id=c4cff41da8b84a87883a6878ed4555c6)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:41.758194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f0bd3-3468-40b6-8213-04b1184f6f2e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:41.759722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Jul 28 17:46:41 2022] GET /identity/v3/users/c4cff41da8b84a87883a6878ed4555c6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:43.795485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767775d-158a-4f39-8953-0a3849ebaa48 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:43.796001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767775d-158a-4f39-8953-0a3849ebaa48 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:43.796101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767775d-158a-4f39-8953-0a3849ebaa48 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:43.797497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:43.802611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c1fd3-4534-4d99-9ff2-a7aed10a8282 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:43.803043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c1fd3-4534-4d99-9ff2-a7aed10a8282 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:43.803159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c1fd3-4534-4d99-9ff2-a7aed10a8282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:43.822873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-098c1fd3-4534-4d99-9ff2-a7aed10a8282 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:43.824049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-098c1fd3-4534-4d99-9ff2-a7aed10a8282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:43.859170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a445eb-546c-4ab6-bd68-81a2b1726b93 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:43.859456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a445eb-546c-4ab6-bd68-81a2b1726b93 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:43.859740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a445eb-546c-4ab6-bd68-81a2b1726b93 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:43.861100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:43.866265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f669a-71e5-452c-926f-1f68e1549907 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:43.866548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f669a-71e5-452c-926f-1f68e1549907 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:43.866826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f669a-71e5-452c-926f-1f68e1549907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:43.903864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:43.908982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG passlib.handlers.bcrypt [None req-c14f669a-71e5-452c-926f-1f68e1549907 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80524) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 17:46:43.909411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG passlib.handlers.bcrypt [None req-c14f669a-71e5-452c-926f-1f68e1549907 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80524) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 17:46:43.925961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c1fd3-4534-4d99-9ff2-a7aed10a8282 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:43.949503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:43.955071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c14f669a-71e5-452c-926f-1f68e1549907 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:43.957236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c14f669a-71e5-452c-926f-1f68e1549907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:44.030244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c1fd3-4534-4d99-9ff2-a7aed10a8282 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:44.055597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:46:44.063545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891c5e7-986b-4314-99c2-50dfb3d09a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:44.064195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891c5e7-986b-4314-99c2-50dfb3d09a31 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:44.064474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891c5e7-986b-4314-99c2-50dfb3d09a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:44.065311 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891c5e7-986b-4314-99c2-50dfb3d09a31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:44.078726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f669a-71e5-452c-926f-1f68e1549907 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:44.079356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891c5e7-986b-4314-99c2-50dfb3d09a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-a891c5e7-986b-4314-99c2-50dfb3d09a31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:44.090908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:44.091987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:46:44.093137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:44.098566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891c5e7-986b-4314-99c2-50dfb3d09a31 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:44.183184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:44.190806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f669a-71e5-452c-926f-1f68e1549907 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:44.196867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:44.201585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891c5e7-986b-4314-99c2-50dfb3d09a31 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:44.227473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb370c2f-c628-4f59-a745-8d4848087fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:44.228347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb370c2f-c628-4f59-a745-8d4848087fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:44.228635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb370c2f-c628-4f59-a745-8d4848087fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:44.228947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb370c2f-c628-4f59-a745-8d4848087fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:44.236759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbc1db-64f4-482b-a4ef-466ba4f996d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:44.237403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbc1db-64f4-482b-a4ef-466ba4f996d5 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:44.237679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbc1db-64f4-482b-a4ef-466ba4f996d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:44.237945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbc1db-64f4-482b-a4ef-466ba4f996d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:44.238661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbc1db-64f4-482b-a4ef-466ba4f996d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:44.238960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbc1db-64f4-482b-a4ef-466ba4f996d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:44.240343 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbc1db-64f4-482b-a4ef-466ba4f996d5 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:44.252208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:44.257645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbc1db-64f4-482b-a4ef-466ba4f996d5 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:44.296732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb370c2f-c628-4f59-a745-8d4848087fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:44.298294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb370c2f-c628-4f59-a745-8d4848087fe8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:44.356739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbc1db-64f4-482b-a4ef-466ba4f996d5 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:44.398828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:46:44.404740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb370c2f-c628-4f59-a745-8d4848087fe8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:44.408022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:44.511980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb370c2f-c628-4f59-a745-8d4848087fe8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:44.512319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4f678-c368-4307-b9f1-9b323d820b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:44.512985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f678-c368-4307-b9f1-9b323d820b50 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:44.513261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f678-c368-4307-b9f1-9b323d820b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:44.513531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f678-c368-4307-b9f1-9b323d820b50 None admin] PATH_INFO: `/v3/users/c4cff41da8b84a87883a6878ed4555c6` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:44.514775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4f678-c368-4307-b9f1-9b323d820b50 None admin] RBAC: Authorizing `identity:get_user(user_id=c4cff41da8b84a87883a6878ed4555c6)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:44.516237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4f678-c368-4307-b9f1-9b323d820b50 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:44.517894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:44 2022] GET /identity/v3/users/c4cff41da8b84a87883a6878ed4555c6 => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:44.523246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4f678-c368-4307-b9f1-9b323d820b50 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:44.538574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:44.546996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d70d-dae2-4fdb-92dc-8bb87d57357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:44.547850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d70d-dae2-4fdb-92dc-8bb87d57357b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:44.548134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d70d-dae2-4fdb-92dc-8bb87d57357b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:44.548409 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d70d-dae2-4fdb-92dc-8bb87d57357b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:44.567385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d70d-dae2-4fdb-92dc-8bb87d57357b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:44.568985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d70d-dae2-4fdb-92dc-8bb87d57357b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9a29d70d-dae2-4fdb-92dc-8bb87d57357b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:44.586886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:44.587704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:44.588506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:46:44.588506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:44.588506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:44.588506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:46:44.588506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 9/18] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:44.593819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d70d-dae2-4fdb-92dc-8bb87d57357b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:44.626944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4f678-c368-4307-b9f1-9b323d820b50 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:44.654008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:44.660660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922448ee-6fdb-49e3-bc92-c2d73fa312e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:44.661327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922448ee-6fdb-49e3-bc92-c2d73fa312e2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:44.661607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922448ee-6fdb-49e3-bc92-c2d73fa312e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:44.661880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922448ee-6fdb-49e3-bc92-c2d73fa312e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:44.663060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922448ee-6fdb-49e3-bc92-c2d73fa312e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:44.664505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922448ee-6fdb-49e3-bc92-c2d73fa312e2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:44.666270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 10/19] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:44.671781 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922448ee-6fdb-49e3-bc92-c2d73fa312e2 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:44.698189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d70d-dae2-4fdb-92dc-8bb87d57357b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:44.730675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bfd96-f598-4b4b-94de-d7c7066cf3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:44.731383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bfd96-f598-4b4b-94de-d7c7066cf3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:44.731735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bfd96-f598-4b4b-94de-d7c7066cf3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:44.732023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bfd96-f598-4b4b-94de-d7c7066cf3f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:44.732759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bfd96-f598-4b4b-94de-d7c7066cf3f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:44.733116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bfd96-f598-4b4b-94de-d7c7066cf3f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:44.734485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bfd96-f598-4b4b-94de-d7c7066cf3f9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:44.752278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 10/20] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:44.752738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:44.772897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922448ee-6fdb-49e3-bc92-c2d73fa312e2 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:44.810748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c5acd-0dde-4f02-a780-f1c2d4ceb623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:44.811401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c5acd-0dde-4f02-a780-f1c2d4ceb623 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:44.811640 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c5acd-0dde-4f02-a780-f1c2d4ceb623 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:44.811909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c5acd-0dde-4f02-a780-f1c2d4ceb623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:44.812711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c5acd-0dde-4f02-a780-f1c2d4ceb623 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.domain.id=default, user.id=c4cff41da8b84a87883a6878ed4555c6) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:44.813110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c5acd-0dde-4f02-a780-f1c2d4ceb623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:44.814585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c5acd-0dde-4f02-a780-f1c2d4ceb623 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:44.822530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 11/21] 10.222.0.67 () {56 vars in 1322 bytes} [Thu Jul 28 17:46:44 2022] GET /identity/v3/role_assignments?user.id=c4cff41da8b84a87883a6878ed4555c6&scope.domain.id=default&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:46.980217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1b0a-5b82-4bb3-8230-843125f06e74 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:46.981238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1b0a-5b82-4bb3-8230-843125f06e74 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:46.981714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1b0a-5b82-4bb3-8230-843125f06e74 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:46.983254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 11/22] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:46.989076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5862ae-d717-447f-9316-bc57dc7764c1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:46.989478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5862ae-d717-447f-9316-bc57dc7764c1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:46.989682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5862ae-d717-447f-9316-bc57dc7764c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.016850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-1f5862ae-d717-447f-9316-bc57dc7764c1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:47.018079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1f5862ae-d717-447f-9316-bc57dc7764c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:47.081405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b451e-d05e-4198-b3b5-c4117d30188a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:47.081720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b451e-d05e-4198-b3b5-c4117d30188a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:47.081985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b451e-d05e-4198-b3b5-c4117d30188a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.083334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 12/23] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:47.088848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fcb62-b0b5-4415-8f90-6c81e13c912b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:47.089217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fcb62-b0b5-4415-8f90-6c81e13c912b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:47.089406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fcb62-b0b5-4415-8f90-6c81e13c912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.113712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 12/24] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:46:47.133813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-088fcb62-b0b5-4415-8f90-6c81e13c912b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:47.135018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-088fcb62-b0b5-4415-8f90-6c81e13c912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:47.183947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5862ae-d717-447f-9316-bc57dc7764c1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:47.286226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 13/25] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:47.308835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:47.333031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fcb62-b0b5-4415-8f90-6c81e13c912b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:47.342919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5862ae-d717-447f-9316-bc57dc7764c1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:47.392230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324dac9-3995-442d-b575-2bb568799dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:47.393789 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324dac9-3995-442d-b575-2bb568799dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:47.394283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324dac9-3995-442d-b575-2bb568799dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:47.394743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324dac9-3995-442d-b575-2bb568799dc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.413842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324dac9-3995-442d-b575-2bb568799dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-4324dac9-3995-442d-b575-2bb568799dc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:47.419231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:47.420046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:47.420832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:46:47.430623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 13/26] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:47.439764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324dac9-3995-442d-b575-2bb568799dc0 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:47.463839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:47.583669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fcb62-b0b5-4415-8f90-6c81e13c912b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:47.638762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252946b-7253-4dd6-8a91-7aa5c8bbd5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:47.639422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252946b-7253-4dd6-8a91-7aa5c8bbd5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:47.639704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252946b-7253-4dd6-8a91-7aa5c8bbd5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:47.639977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252946b-7253-4dd6-8a91-7aa5c8bbd5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.658253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252946b-7253-4dd6-8a91-7aa5c8bbd5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:47.660264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252946b-7253-4dd6-8a91-7aa5c8bbd5a1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:47.674960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324dac9-3995-442d-b575-2bb568799dc0 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b252946b-7253-4dd6-8a91-7aa5c8bbd5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:46:47.683833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:47.684977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:47.685759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:46:47.685759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:46:47.685759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:46:47.685759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:46:47.685759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 14/27] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:47.692511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252946b-7253-4dd6-8a91-7aa5c8bbd5a1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:47.746169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52679a-d17c-480a-befb-fe7a27bfbd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:47.746857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52679a-d17c-480a-befb-fe7a27bfbd83 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:47.747141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52679a-d17c-480a-befb-fe7a27bfbd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:47.747413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52679a-d17c-480a-befb-fe7a27bfbd83 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.748144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52679a-d17c-480a-befb-fe7a27bfbd83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:47.748458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52679a-d17c-480a-befb-fe7a27bfbd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:47.749898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52679a-d17c-480a-befb-fe7a27bfbd83 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:47.751466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:47.768988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 14/28] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:47.770443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d363a-831e-4b28-b765-dfde1019d24b None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:47.770717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d363a-831e-4b28-b765-dfde1019d24b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:47.771002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d363a-831e-4b28-b765-dfde1019d24b None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.772249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 15/29] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:47.781892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d363a-831e-4b28-b765-dfde1019d24b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:47.827751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:47.832067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252946b-7253-4dd6-8a91-7aa5c8bbd5a1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:47.959024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d363a-831e-4b28-b765-dfde1019d24b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:47.982272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca7678-f369-4b3a-b055-5ea02810d50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:47.982943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7678-f369-4b3a-b055-5ea02810d50f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:47.983176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7678-f369-4b3a-b055-5ea02810d50f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:47.983450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7678-f369-4b3a-b055-5ea02810d50f None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:47.984143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca7678-f369-4b3a-b055-5ea02810d50f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:47.984447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca7678-f369-4b3a-b055-5ea02810d50f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:47.985867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca7678-f369-4b3a-b055-5ea02810d50f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:47.999223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 15/30] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:48.000698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9ee51-5b42-4787-aac6-5729b805dcef None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.001036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9ee51-5b42-4787-aac6-5729b805dcef None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.001315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9ee51-5b42-4787-aac6-5729b805dcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.006291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dc4cb-96d9-4df9-a967-916fdcddcee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:48.007758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dc4cb-96d9-4df9-a967-916fdcddcee3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.008237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dc4cb-96d9-4df9-a967-916fdcddcee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.009539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dc4cb-96d9-4df9-a967-916fdcddcee3 None admin] PATH_INFO: `/v3/users/c4cff41da8b84a87883a6878ed4555c6` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.010915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dc4cb-96d9-4df9-a967-916fdcddcee3 None admin] RBAC: Authorizing `identity:get_user(user_id=c4cff41da8b84a87883a6878ed4555c6)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:48.012541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dc4cb-96d9-4df9-a967-916fdcddcee3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:48.014797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 16/31] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:47 2022] GET /identity/v3/users/c4cff41da8b84a87883a6878ed4555c6 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:48.016109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955ffd-8b50-4a4e-a8f3-25e601d6232d None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.016564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955ffd-8b50-4a4e-a8f3-25e601d6232d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.017019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955ffd-8b50-4a4e-a8f3-25e601d6232d None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.019029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 17/32] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:48.019917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa955ffd-8b50-4a4e-a8f3-25e601d6232d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:48.028801 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-40e9ee51-5b42-4787-aac6-5729b805dcef None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:48.030171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-40e9ee51-5b42-4787-aac6-5729b805dcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:48.098987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:48.109755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 16/33] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:48.110953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9ee51-5b42-4787-aac6-5729b805dcef None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:48.144747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa955ffd-8b50-4a4e-a8f3-25e601d6232d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:48.180061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b84c-795a-4992-a395-7cfbf05fc578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:48.180752 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b84c-795a-4992-a395-7cfbf05fc578 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.181237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b84c-795a-4992-a395-7cfbf05fc578 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.181409 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b84c-795a-4992-a395-7cfbf05fc578 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.182275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b84c-795a-4992-a395-7cfbf05fc578 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:48.183771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b84c-795a-4992-a395-7cfbf05fc578 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:48.216138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:48.229003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9ee51-5b42-4787-aac6-5729b805dcef None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:48.263599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41563b41-1cda-482d-af6f-2446adc53c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:48.264249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41563b41-1cda-482d-af6f-2446adc53c7e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.264607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41563b41-1cda-482d-af6f-2446adc53c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.264932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41563b41-1cda-482d-af6f-2446adc53c7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.266282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41563b41-1cda-482d-af6f-2446adc53c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:48.267725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41563b41-1cda-482d-af6f-2446adc53c7e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:48.272877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 17/34] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:48.272877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96293e8d-406e-49db-9cd5-8952457e7a05 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.272877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96293e8d-406e-49db-9cd5-8952457e7a05 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.272877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96293e8d-406e-49db-9cd5-8952457e7a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.291043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-96293e8d-406e-49db-9cd5-8952457e7a05 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:48.292219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-96293e8d-406e-49db-9cd5-8952457e7a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:48.367796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 18/35] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:48.369029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96293e8d-406e-49db-9cd5-8952457e7a05 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:48.424370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 18/36] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:46:48 2022] POST /identity/v3/projects => generated 301 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:48.425376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b84c-795a-4992-a395-7cfbf05fc578 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:48.482037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96293e8d-406e-49db-9cd5-8952457e7a05 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:48.485181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:48.522950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10a755-d642-428d-a9ea-8f0413127797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:48.523603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a755-d642-428d-a9ea-8f0413127797 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.523883 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a755-d642-428d-a9ea-8f0413127797 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.524155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a755-d642-428d-a9ea-8f0413127797 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.524917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10a755-d642-428d-a9ea-8f0413127797 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:48.526337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10a755-d642-428d-a9ea-8f0413127797 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:48.558430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b84c-795a-4992-a395-7cfbf05fc578 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:48.579970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:48.601331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62ef2d-ccd9-4d8d-b81e-5d62860a9d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:48.602329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62ef2d-ccd9-4d8d-b81e-5d62860a9d1e None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.602561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62ef2d-ccd9-4d8d-b81e-5d62860a9d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.602845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62ef2d-ccd9-4d8d-b81e-5d62860a9d1e None admin] PATH_INFO: `/v3/domains/default/users/c4cff41da8b84a87883a6878ed4555c6/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.605204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62ef2d-ccd9-4d8d-b81e-5d62860a9d1e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c4cff41da8b84a87883a6878ed4555c6, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:48.606944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62ef2d-ccd9-4d8d-b81e-5d62860a9d1e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:48.734766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 19/37] 10.222.0.67 () {58 vars in 1361 bytes} [Thu Jul 28 17:46:48 2022] PUT /identity/v3/domains/default/users/c4cff41da8b84a87883a6878ed4555c6/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:46:48.735882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62ef2d-ccd9-4d8d-b81e-5d62860a9d1e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:48.737277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 19/38] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 28 17:46:48 2022] POST /identity/v3/roles => generated 219 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:48.738741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a67af8-64cc-4c4c-85b1-33d19061b142 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.739061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a67af8-64cc-4c4c-85b1-33d19061b142 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.739357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a67af8-64cc-4c4c-85b1-33d19061b142 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.740975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 20/39] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:48.747032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ba83-f789-4a5e-850f-bac1176c5d80 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.747323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ba83-f789-4a5e-850f-bac1176c5d80 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.749335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ba83-f789-4a5e-850f-bac1176c5d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.771113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1864ba83-f789-4a5e-850f-bac1176c5d80 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:48.773126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1864ba83-f789-4a5e-850f-bac1176c5d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:48.862492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 21/40] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:46:48.864594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17cf2-3729-4a17-9e82-9c49b7af1de5 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.865099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17cf2-3729-4a17-9e82-9c49b7af1de5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.865519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17cf2-3729-4a17-9e82-9c49b7af1de5 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.867108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 22/41] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:48.883025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33a383-f6f9-48aa-b8ef-796eeae8c487 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.883681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33a383-f6f9-48aa-b8ef-796eeae8c487 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.883971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33a383-f6f9-48aa-b8ef-796eeae8c487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.901751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62ef2d-ccd9-4d8d-b81e-5d62860a9d1e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:48.916516 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5a33a383-f6f9-48aa-b8ef-796eeae8c487 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:48.918051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5a33a383-f6f9-48aa-b8ef-796eeae8c487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:48.954903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5ee2d-804a-4a92-b41d-b4f199739f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:48.954903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5ee2d-804a-4a92-b41d-b4f199739f21 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:48.955915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5ee2d-804a-4a92-b41d-b4f199739f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:48.956298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5ee2d-804a-4a92-b41d-b4f199739f21 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:48.957306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5ee2d-804a-4a92-b41d-b4f199739f21 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:48.959090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5ee2d-804a-4a92-b41d-b4f199739f21 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:49.000829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 23/42] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 17:46:49.002865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33a383-f6f9-48aa-b8ef-796eeae8c487 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:49.011588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:49.050284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 20/43] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 28 17:46:48 2022] POST /identity/v3/roles => generated 225 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:49.051206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5ee2d-804a-4a92-b41d-b4f199739f21 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:49.097219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:49.129834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33a383-f6f9-48aa-b8ef-796eeae8c487 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:49.179057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cb7c5-5735-494c-9b4c-0b54c3edbcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:49.179591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cb7c5-5735-494c-9b4c-0b54c3edbcfa None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:49.179874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cb7c5-5735-494c-9b4c-0b54c3edbcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:49.180149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cb7c5-5735-494c-9b4c-0b54c3edbcfa None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:49.180980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cb7c5-5735-494c-9b4c-0b54c3edbcfa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:49.182540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cb7c5-5735-494c-9b4c-0b54c3edbcfa None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:49.196352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5ee2d-804a-4a92-b41d-b4f199739f21 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:49.233414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20840d70-f1d6-4026-b84e-bba69908522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:49.234074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20840d70-f1d6-4026-b84e-bba69908522d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:49.234360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20840d70-f1d6-4026-b84e-bba69908522d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:49.234641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20840d70-f1d6-4026-b84e-bba69908522d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:49.235844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20840d70-f1d6-4026-b84e-bba69908522d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:49.237926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20840d70-f1d6-4026-b84e-bba69908522d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:49.239985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 21/44] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:49.245613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20840d70-f1d6-4026-b84e-bba69908522d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:49.321137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 24/45] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 28 17:46:49 2022] POST /identity/v3/roles => generated 223 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:49.390556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20840d70-f1d6-4026-b84e-bba69908522d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:49.393283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:49.428141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af83f4-ac62-4359-9f54-e650be8f7dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:49.428821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af83f4-ac62-4359-9f54-e650be8f7dc5 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:49.429167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af83f4-ac62-4359-9f54-e650be8f7dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:49.429448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af83f4-ac62-4359-9f54-e650be8f7dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:49.430285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af83f4-ac62-4359-9f54-e650be8f7dc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:49.432024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af83f4-ac62-4359-9f54-e650be8f7dc5 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:49.519730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 22/46] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:46:49 2022] POST /identity/v3/projects => generated 312 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:46:50.845440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7bfd-3d22-4100-928c-40a5602e0506 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:50.846460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7bfd-3d22-4100-928c-40a5602e0506 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:50.846574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7bfd-3d22-4100-928c-40a5602e0506 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:50.847900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 25/47] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:50.853432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666143b-0a40-415d-b493-0438a28c30ba None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:50.853842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666143b-0a40-415d-b493-0438a28c30ba None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:50.853999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666143b-0a40-415d-b493-0438a28c30ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:50.872627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f666143b-0a40-415d-b493-0438a28c30ba None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:50.874178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f666143b-0a40-415d-b493-0438a28c30ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:50.939092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 23/48] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:50.962288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c7bfd-3d22-4100-928c-40a5602e0506 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:51.028920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:51.064546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c7bfd-3d22-4100-928c-40a5602e0506 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:51.101300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c95a4-7b35-4eb0-a00c-bc334e0a245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:51.101872 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c95a4-7b35-4eb0-a00c-bc334e0a245c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:51.102158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c95a4-7b35-4eb0-a00c-bc334e0a245c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:51.102437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c95a4-7b35-4eb0-a00c-bc334e0a245c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:51.115239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c95a4-7b35-4eb0-a00c-bc334e0a245c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-010c95a4-7b35-4eb0-a00c-bc334e0a245c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:51.121456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:51.122306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:46:51.123055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 26/49] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:51.128556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666143b-0a40-415d-b493-0438a28c30ba None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:51.214319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:51.229147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666143b-0a40-415d-b493-0438a28c30ba None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:51.263345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067a963-1929-4b34-be74-73c48fb8d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:51.263955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067a963-1929-4b34-be74-73c48fb8d519 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:51.264235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067a963-1929-4b34-be74-73c48fb8d519 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:51.264513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067a963-1929-4b34-be74-73c48fb8d519 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:51.265265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067a963-1929-4b34-be74-73c48fb8d519 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:51.265571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067a963-1929-4b34-be74-73c48fb8d519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:51.266954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067a963-1929-4b34-be74-73c48fb8d519 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:51.275551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 24/50] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:51.281195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c95a4-7b35-4eb0-a00c-bc334e0a245c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:51.380296 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c95a4-7b35-4eb0-a00c-bc334e0a245c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:51.407050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:51.415354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79e49e-831e-447f-9db6-a373366c1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:51.416050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e49e-831e-447f-9db6-a373366c1199 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:51.416334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e49e-831e-447f-9db6-a373366c1199 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:51.416611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e49e-831e-447f-9db6-a373366c1199 None admin] PATH_INFO: `/v3/users/c4cff41da8b84a87883a6878ed4555c6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:51.418044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79e49e-831e-447f-9db6-a373366c1199 None admin] RBAC: Authorizing `identity:get_user(user_id=c4cff41da8b84a87883a6878ed4555c6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:51.419533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79e49e-831e-447f-9db6-a373366c1199 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:51.435903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 27/51] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:51 2022] GET /identity/v3/users/c4cff41da8b84a87883a6878ed4555c6 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:51.436050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067a963-1929-4b34-be74-73c48fb8d519 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:51.523176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9abb1e-67b7-47ff-ab2c-90cf8086018b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:51.523460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9abb1e-67b7-47ff-ab2c-90cf8086018b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:51.523743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9abb1e-67b7-47ff-ab2c-90cf8086018b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:51.525126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 28/52] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:46:51.527226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067a963-1929-4b34-be74-73c48fb8d519 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:51.530001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb58d-a7d4-4fc9-b22e-65ad68ef87bf None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:51.530291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb58d-a7d4-4fc9-b22e-65ad68ef87bf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:51.530568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb58d-a7d4-4fc9-b22e-65ad68ef87bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:51.548494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-854fb58d-a7d4-4fc9-b22e-65ad68ef87bf None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:51.550323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-854fb58d-a7d4-4fc9-b22e-65ad68ef87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:51.561660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02de4d4-b8d1-4dd2-a869-d3ac76c900f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:51.562301 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02de4d4-b8d1-4dd2-a869-d3ac76c900f3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:51.562579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02de4d4-b8d1-4dd2-a869-d3ac76c900f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:51.562853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02de4d4-b8d1-4dd2-a869-d3ac76c900f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:51.564025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02de4d4-b8d1-4dd2-a869-d3ac76c900f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:51.565544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02de4d4-b8d1-4dd2-a869-d3ac76c900f3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:51.567117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 25/53] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:51.572873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02de4d4-b8d1-4dd2-a869-d3ac76c900f3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:51.590457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:51.617259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 29/54] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:46:51.639611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb58d-a7d4-4fc9-b22e-65ad68ef87bf None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:51.670346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02de4d4-b8d1-4dd2-a869-d3ac76c900f3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:51.704218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5edeeb-9a93-4890-9357-4116babff159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:51.704860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5edeeb-9a93-4890-9357-4116babff159 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:51.705151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5edeeb-9a93-4890-9357-4116babff159 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:51.705474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5edeeb-9a93-4890-9357-4116babff159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:51.706267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5edeeb-9a93-4890-9357-4116babff159 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.domain.id=default, user.id=c4cff41da8b84a87883a6878ed4555c6) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:51.706579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5edeeb-9a93-4890-9357-4116babff159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:51.708024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5edeeb-9a93-4890-9357-4116babff159 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:51.713764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 26/55] 10.222.0.67 () {56 vars in 1322 bytes} [Thu Jul 28 17:46:51 2022] GET /identity/v3/role_assignments?user.id=c4cff41da8b84a87883a6878ed4555c6&scope.domain.id=default&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:51.739598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb58d-a7d4-4fc9-b22e-65ad68ef87bf None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:51.765027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:51.776558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec225886-27c9-4656-a135-9d0cc0e201c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:51.777246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec225886-27c9-4656-a135-9d0cc0e201c7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:51.777531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec225886-27c9-4656-a135-9d0cc0e201c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:51.779188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec225886-27c9-4656-a135-9d0cc0e201c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:51.779188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec225886-27c9-4656-a135-9d0cc0e201c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:51.780512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec225886-27c9-4656-a135-9d0cc0e201c7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:51.782220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 30/56] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:46:51.788697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5edeeb-9a93-4890-9357-4116babff159 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:51.874301 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:51.893273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5edeeb-9a93-4890-9357-4116babff159 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:51.927685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31ea98-7840-4988-82a2-706a527f2f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:51.928315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31ea98-7840-4988-82a2-706a527f2f88 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:51.928597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31ea98-7840-4988-82a2-706a527f2f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:51.928898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31ea98-7840-4988-82a2-706a527f2f88 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:51.929579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31ea98-7840-4988-82a2-706a527f2f88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:51.931075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31ea98-7840-4988-82a2-706a527f2f88 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:52.026944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 27/57] 10.222.0.67 () {60 vars in 1140 bytes} [Thu Jul 28 17:46:51 2022] POST /identity/v3/projects => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:54.019773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9f8b-01b6-409b-834f-c643e9dde270 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:54.020289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9f8b-01b6-409b-834f-c643e9dde270 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:54.020371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae9f8b-01b6-409b-834f-c643e9dde270 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:54.021700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 31/58] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:54.026779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08546-f39a-41cf-bfad-7745dea6c112 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:54.027213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08546-f39a-41cf-bfad-7745dea6c112 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:54.027349 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf08546-f39a-41cf-bfad-7745dea6c112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:54.045551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-5cf08546-f39a-41cf-bfad-7745dea6c112 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:54.046749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5cf08546-f39a-41cf-bfad-7745dea6c112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:54.111711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 28/59] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:54.134673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9f8b-01b6-409b-834f-c643e9dde270 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:54.236976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae9f8b-01b6-409b-834f-c643e9dde270 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:54.270066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130507f9-02b9-409b-aba9-657d1c1d0801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:54.270648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130507f9-02b9-409b-aba9-657d1c1d0801 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:54.270934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130507f9-02b9-409b-aba9-657d1c1d0801 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:54.271210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130507f9-02b9-409b-aba9-657d1c1d0801 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:54.272354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130507f9-02b9-409b-aba9-657d1c1d0801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:54.273827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130507f9-02b9-409b-aba9-657d1c1d0801 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:54.275402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 32/60] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:54.280980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08546-f39a-41cf-bfad-7745dea6c112 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:54.340280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:54.375997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf08546-f39a-41cf-bfad-7745dea6c112 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:54.409282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bd9ba-9904-4570-90e5-b51c6b246c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:54.409892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd9ba-9904-4570-90e5-b51c6b246c52 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:54.410176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd9ba-9904-4570-90e5-b51c6b246c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:54.410452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd9ba-9904-4570-90e5-b51c6b246c52 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:54.411138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bd9ba-9904-4570-90e5-b51c6b246c52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:54.412623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bd9ba-9904-4570-90e5-b51c6b246c52 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:54.601203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 29/61] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:46:54 2022] POST /identity/v3/users => generated 275 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:57.837459 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684abc02-0888-4f70-8649-b2f4606b7e5d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:57.838538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684abc02-0888-4f70-8649-b2f4606b7e5d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:57.839084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684abc02-0888-4f70-8649-b2f4606b7e5d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:57.840930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 33/62] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:57.846004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1fe72-91ad-4b72-a555-5e0c2cc5b40e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:57.846464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1fe72-91ad-4b72-a555-5e0c2cc5b40e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:57.846540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1fe72-91ad-4b72-a555-5e0c2cc5b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:57.874790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-39e1fe72-91ad-4b72-a555-5e0c2cc5b40e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:57.875998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-39e1fe72-91ad-4b72-a555-5e0c2cc5b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:57.964166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010322-317c-4028-bceb-711b4a48ec48 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:57.964998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010322-317c-4028-bceb-711b4a48ec48 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:57.965521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010322-317c-4028-bceb-711b4a48ec48 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:57.967097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 34/63] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:57.972774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 30/64] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:57.974864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa900ed-f1e0-4679-bbf6-4e69deef77bf None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:57.975384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa900ed-f1e0-4679-bbf6-4e69deef77bf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:57.975908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa900ed-f1e0-4679-bbf6-4e69deef77bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:57.995295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1fe72-91ad-4b72-a555-5e0c2cc5b40e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.004994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3fa900ed-f1e0-4679-bbf6-4e69deef77bf None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:58.006497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3fa900ed-f1e0-4679-bbf6-4e69deef77bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:58.050109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:58.079588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:58.093845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 35/65] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:58.095398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c6c84-3004-409b-bdb1-d7117b5a0253 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.096413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c6c84-3004-409b-bdb1-d7117b5a0253 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.096930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c6c84-3004-409b-bdb1-d7117b5a0253 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.099085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 36/66] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:58.104630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b666a-1cdd-442f-988a-a39dde2911e3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.105424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b666a-1cdd-442f-988a-a39dde2911e3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.105864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b666a-1cdd-442f-988a-a39dde2911e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.120776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1fe72-91ad-4b72-a555-5e0c2cc5b40e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.127758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-217b666a-1cdd-442f-988a-a39dde2911e3 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:58.129808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-217b666a-1cdd-442f-988a-a39dde2911e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:58.157180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ea09b-5b7e-4ac1-88d3-714b357b2473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:58.157830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ea09b-5b7e-4ac1-88d3-714b357b2473 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.158117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ea09b-5b7e-4ac1-88d3-714b357b2473 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.158914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ea09b-5b7e-4ac1-88d3-714b357b2473 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.177523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ea09b-5b7e-4ac1-88d3-714b357b2473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-909ea09b-5b7e-4ac1-88d3-714b357b2473 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:58.182621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:58.183493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:46:58.184534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 31/67] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:46:58.185656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef36aa-8449-4916-88fd-2ba12c01afed None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.185656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef36aa-8449-4916-88fd-2ba12c01afed None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.185930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef36aa-8449-4916-88fd-2ba12c01afed None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.191219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 32/68] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:58.191219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef36aa-8449-4916-88fd-2ba12c01afed None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.211984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 37/69] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:46:58.213904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b666a-1cdd-442f-988a-a39dde2911e3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.308251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef36aa-8449-4916-88fd-2ba12c01afed None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.318397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b666a-1cdd-442f-988a-a39dde2911e3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.318985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:58.339862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:58.345185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9b3a3-478d-4384-8fc3-ea55c4bdd0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:58.346499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b3a3-478d-4384-8fc3-ea55c4bdd0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.346783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b3a3-478d-4384-8fc3-ea55c4bdd0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.347056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b3a3-478d-4384-8fc3-ea55c4bdd0e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.355313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f5f7-8f7b-4181-9f32-112b043c6978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:58.376535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f5f7-8f7b-4181-9f32-112b043c6978 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.376535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f5f7-8f7b-4181-9f32-112b043c6978 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.376535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f5f7-8f7b-4181-9f32-112b043c6978 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.376535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78f5f7-8f7b-4181-9f32-112b043c6978 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:58.376535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78f5f7-8f7b-4181-9f32-112b043c6978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:58.377143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9b3a3-478d-4384-8fc3-ea55c4bdd0e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:58.377238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78f5f7-8f7b-4181-9f32-112b043c6978 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-cea9b3a3-478d-4384-8fc3-ea55c4bdd0e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:58.377319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:58.378305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 33/70] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:58.379264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c68d6-98f4-461a-96c4-7ebbe2e81c8a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.380034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c68d6-98f4-461a-96c4-7ebbe2e81c8a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.380034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c68d6-98f4-461a-96c4-7ebbe2e81c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.380154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 38/71] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:58.380154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f5f7-8f7b-4181-9f32-112b043c6978 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.384620 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-3f5c68d6-98f4-461a-96c4-7ebbe2e81c8a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:58.385847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-3f5c68d6-98f4-461a-96c4-7ebbe2e81c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:58.451229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 34/72] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:58.473852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f84a5-fff3-45c6-acbb-14aea9a268af None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.473852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f84a5-fff3-45c6-acbb-14aea9a268af None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.473852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f84a5-fff3-45c6-acbb-14aea9a268af None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.473852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 35/73] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:46:58.473852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f84a5-fff3-45c6-acbb-14aea9a268af None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.474224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f5f7-8f7b-4181-9f32-112b043c6978 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.505172 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10944d7-fbd1-44d8-aee2-29e592d76f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:58.505877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10944d7-fbd1-44d8-aee2-29e592d76f39 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.506148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10944d7-fbd1-44d8-aee2-29e592d76f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.506431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10944d7-fbd1-44d8-aee2-29e592d76f39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.516833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10944d7-fbd1-44d8-aee2-29e592d76f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e10944d7-fbd1-44d8-aee2-29e592d76f39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:58.522368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:58.525877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 39/74] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:58.526622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10944d7-fbd1-44d8-aee2-29e592d76f39 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.566184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:58.567721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:58.576843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f84a5-fff3-45c6-acbb-14aea9a268af None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.608065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6041056-6ef5-42bd-a003-b5f19440fcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:58.608610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6041056-6ef5-42bd-a003-b5f19440fcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.608925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6041056-6ef5-42bd-a003-b5f19440fcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.609203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6041056-6ef5-42bd-a003-b5f19440fcb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.609921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6041056-6ef5-42bd-a003-b5f19440fcb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:58.610230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6041056-6ef5-42bd-a003-b5f19440fcb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:58.612266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6041056-6ef5-42bd-a003-b5f19440fcb0 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:58.620091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 36/75] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:58.621275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee238-d254-4a7d-b1e7-04bbbaec149a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.621564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee238-d254-4a7d-b1e7-04bbbaec149a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.621853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee238-d254-4a7d-b1e7-04bbbaec149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.626934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10944d7-fbd1-44d8-aee2-29e592d76f39 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.639356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a64ee238-d254-4a7d-b1e7-04bbbaec149a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:46:58.640619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a64ee238-d254-4a7d-b1e7-04bbbaec149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:46:58.659993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369eaaa-e33a-4a58-a94b-3e2ef2a7eae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:58.660641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369eaaa-e33a-4a58-a94b-3e2ef2a7eae2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.660953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369eaaa-e33a-4a58-a94b-3e2ef2a7eae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.661231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369eaaa-e33a-4a58-a94b-3e2ef2a7eae2 None admin] PATH_INFO: `/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.676119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369eaaa-e33a-4a58-a94b-3e2ef2a7eae2 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff0fdbd5cea443b8457e0eba48b93ac)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:58.677597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369eaaa-e33a-4a58-a94b-3e2ef2a7eae2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:58.679219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 40/76] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:58.679988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369eaaa-e33a-4a58-a94b-3e2ef2a7eae2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.706275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 37/77] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:46:58.707123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ee238-d254-4a7d-b1e7-04bbbaec149a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.780801 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:58.784272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369eaaa-e33a-4a58-a94b-3e2ef2a7eae2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.800008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:58.816474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ee238-d254-4a7d-b1e7-04bbbaec149a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.818468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b034-7bdb-4974-a7f6-5780df3988c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:58.819134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b034-7bdb-4974-a7f6-5780df3988c0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.819418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b034-7bdb-4974-a7f6-5780df3988c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.819699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b034-7bdb-4974-a7f6-5780df3988c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.829876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44b034-7bdb-4974-a7f6-5780df3988c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9e44b034-7bdb-4974-a7f6-5780df3988c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:46:58.834891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:46:58.835770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:46:58.836515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 41/78] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:46:58.837196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b034-7bdb-4974-a7f6-5780df3988c0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.856347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd4ee7-11c2-4ab5-8b44-e33214073c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:58.857024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd4ee7-11c2-4ab5-8b44-e33214073c12 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.857304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd4ee7-11c2-4ab5-8b44-e33214073c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.857577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd4ee7-11c2-4ab5-8b44-e33214073c12 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.858353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd4ee7-11c2-4ab5-8b44-e33214073c12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:58.858600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd4ee7-11c2-4ab5-8b44-e33214073c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:58.859982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd4ee7-11c2-4ab5-8b44-e33214073c12 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:58.868520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 38/79] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:58.869345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd4ee7-11c2-4ab5-8b44-e33214073c12 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:58.937714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b034-7bdb-4974-a7f6-5780df3988c0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.969046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd4ee7-11c2-4ab5-8b44-e33214073c12 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:58.984277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ecec2-7aa0-464b-b30b-1fbe066b71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:58.984972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ecec2-7aa0-464b-b30b-1fbe066b71bb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:58.985259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ecec2-7aa0-464b-b30b-1fbe066b71bb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:58.985537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ecec2-7aa0-464b-b30b-1fbe066b71bb None admin] PATH_INFO: `/v3/users/c4cff41da8b84a87883a6878ed4555c6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:58.987347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ecec2-7aa0-464b-b30b-1fbe066b71bb None admin] RBAC: Authorizing `identity:get_user(user_id=c4cff41da8b84a87883a6878ed4555c6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:58.988859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ecec2-7aa0-464b-b30b-1fbe066b71bb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:58.990531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 42/80] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/users/c4cff41da8b84a87883a6878ed4555c6 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:58.995312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ecec2-7aa0-464b-b30b-1fbe066b71bb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.015321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02cf78-1b5a-4b56-aa32-0c8450fb7c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.015945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02cf78-1b5a-4b56-aa32-0c8450fb7c43 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.016229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02cf78-1b5a-4b56-aa32-0c8450fb7c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.016580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02cf78-1b5a-4b56-aa32-0c8450fb7c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.020679 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.045216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.094181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02cf78-1b5a-4b56-aa32-0c8450fb7c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.095642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02cf78-1b5a-4b56-aa32-0c8450fb7c43 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.096573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ecec2-7aa0-464b-b30b-1fbe066b71bb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.131101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8560a2f-6c8d-4b1e-b038-88a2ecd5a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.131667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8560a2f-6c8d-4b1e-b038-88a2ecd5a8ce None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.131950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8560a2f-6c8d-4b1e-b038-88a2ecd5a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.132340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8560a2f-6c8d-4b1e-b038-88a2ecd5a8ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.133540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8560a2f-6c8d-4b1e-b038-88a2ecd5a8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.134977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8560a2f-6c8d-4b1e-b038-88a2ecd5a8ce None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.136576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 43/81] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:59.137378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8560a2f-6c8d-4b1e-b038-88a2ecd5a8ce None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.204439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 39/82] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:59.206098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02cf78-1b5a-4b56-aa32-0c8450fb7c43 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.245603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.251202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8560a2f-6c8d-4b1e-b038-88a2ecd5a8ce None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.261907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.287815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce299bcc-dd04-4e57-9ab7-84ee28f980f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.288449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce299bcc-dd04-4e57-9ab7-84ee28f980f8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.288730 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce299bcc-dd04-4e57-9ab7-84ee28f980f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.289030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce299bcc-dd04-4e57-9ab7-84ee28f980f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.289769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce299bcc-dd04-4e57-9ab7-84ee28f980f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:46:59.290052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce299bcc-dd04-4e57-9ab7-84ee28f980f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.291422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce299bcc-dd04-4e57-9ab7-84ee28f980f8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.301163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 44/83] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:59.303647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce299bcc-dd04-4e57-9ab7-84ee28f980f8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.311292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02cf78-1b5a-4b56-aa32-0c8450fb7c43 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.352038 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060776ec-559e-4ece-b930-1fb8dd356888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.352939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060776ec-559e-4ece-b930-1fb8dd356888 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.353296 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060776ec-559e-4ece-b930-1fb8dd356888 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.353566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060776ec-559e-4ece-b930-1fb8dd356888 None admin] PATH_INFO: `/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.354760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060776ec-559e-4ece-b930-1fb8dd356888 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff0fdbd5cea443b8457e0eba48b93ac)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.356226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060776ec-559e-4ece-b930-1fb8dd356888 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.357944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 40/84] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:59.358616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060776ec-559e-4ece-b930-1fb8dd356888 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.437281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce299bcc-dd04-4e57-9ab7-84ee28f980f8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.472867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060776ec-559e-4ece-b930-1fb8dd356888 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.473627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f56aa-04b7-4ad3-8712-93fba3a3afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.474261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f56aa-04b7-4ad3-8712-93fba3a3afa1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.474542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f56aa-04b7-4ad3-8712-93fba3a3afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.474821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f56aa-04b7-4ad3-8712-93fba3a3afa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.494674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.505846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.508933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb40eb-6062-46b7-a644-0649e067ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.509696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb40eb-6062-46b7-a644-0649e067ebb2 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.509982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb40eb-6062-46b7-a644-0649e067ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.510258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb40eb-6062-46b7-a644-0649e067ebb2 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.510951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb40eb-6062-46b7-a644-0649e067ebb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.512394 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb40eb-6062-46b7-a644-0649e067ebb2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.551022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f56aa-04b7-4ad3-8712-93fba3a3afa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.552500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f56aa-04b7-4ad3-8712-93fba3a3afa1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.597788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 41/85] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:46:59 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:46:59.598628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb40eb-6062-46b7-a644-0649e067ebb2 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.675366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 45/86] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:46:59.685508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f56aa-04b7-4ad3-8712-93fba3a3afa1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.739299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb40eb-6062-46b7-a644-0649e067ebb2 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.764265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.790604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065472c-1cf9-4138-b6fd-7852a669dd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.791263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065472c-1cf9-4138-b6fd-7852a669dd78 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.791547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065472c-1cf9-4138-b6fd-7852a669dd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.791826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065472c-1cf9-4138-b6fd-7852a669dd78 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.793163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065472c-1cf9-4138-b6fd-7852a669dd78 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.794772 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065472c-1cf9-4138-b6fd-7852a669dd78 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.797556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 42/87] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:59.797556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065472c-1cf9-4138-b6fd-7852a669dd78 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.828247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f56aa-04b7-4ad3-8712-93fba3a3afa1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.857871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:46:59.872606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf3065-e94c-4a29-a215-8aad7937f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.873266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf3065-e94c-4a29-a215-8aad7937f66e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.873549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf3065-e94c-4a29-a215-8aad7937f66e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.873823 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf3065-e94c-4a29-a215-8aad7937f66e None admin] PATH_INFO: `/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:46:59.875172 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf3065-e94c-4a29-a215-8aad7937f66e None admin] RBAC: Authorizing `identity:get_user(user_id=7ff0fdbd5cea443b8457e0eba48b93ac)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:46:59.878423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf3065-e94c-4a29-a215-8aad7937f66e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:46:59.880507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 46/88] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:46:59.881266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf3065-e94c-4a29-a215-8aad7937f66e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:46:59.945306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065472c-1cf9-4138-b6fd-7852a669dd78 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:46:59.988563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34b1ed-ddd8-4024-a6a7-ec415b24ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:46:59.989554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34b1ed-ddd8-4024-a6a7-ec415b24ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:46:59.990433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34b1ed-ddd8-4024-a6a7-ec415b24ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:46:59.991011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34b1ed-ddd8-4024-a6a7-ec415b24ccd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.017489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf3065-e94c-4a29-a215-8aad7937f66e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:00.047756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:00.061983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6f492-113b-436c-acc2-d6d9b9c98284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:00.063475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6f492-113b-436c-acc2-d6d9b9c98284 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:00.063913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6f492-113b-436c-acc2-d6d9b9c98284 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:00.064326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6f492-113b-436c-acc2-d6d9b9c98284 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.066717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6f492-113b-436c-acc2-d6d9b9c98284 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:00.070347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6f492-113b-436c-acc2-d6d9b9c98284 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:00.075134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 47/89] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:00.077412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6f492-113b-436c-acc2-d6d9b9c98284 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:00.090836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34b1ed-ddd8-4024-a6a7-ec415b24ccd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:00.092545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34b1ed-ddd8-4024-a6a7-ec415b24ccd4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:00.143498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:00.212019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 43/90] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:00.213048 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34b1ed-ddd8-4024-a6a7-ec415b24ccd4 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:00.218010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6f492-113b-436c-acc2-d6d9b9c98284 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:00.259427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ea58e-7fb1-4543-a559-5b87ce778042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:00.260272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ea58e-7fb1-4543-a559-5b87ce778042 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:00.260712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ea58e-7fb1-4543-a559-5b87ce778042 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:00.261173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ea58e-7fb1-4543-a559-5b87ce778042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.262099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ea58e-7fb1-4543-a559-5b87ce778042 None admin] RBAC: Adding query filter params (role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=f98454c570304481a24ebb7a92189d26, user.id=7ff0fdbd5cea443b8457e0eba48b93ac) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:00.262541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ea58e-7fb1-4543-a559-5b87ce778042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:00.264586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ea58e-7fb1-4543-a559-5b87ce778042 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:00.275756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 48/91] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:00 2022] GET /identity/v3/role_assignments?user.id=7ff0fdbd5cea443b8457e0eba48b93ac&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:00.276864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ea58e-7fb1-4543-a559-5b87ce778042 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:00.389151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:00.391136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34b1ed-ddd8-4024-a6a7-ec415b24ccd4 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:00.438480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9f9ae-716a-4322-a432-bc564c30bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:00.439359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9f9ae-716a-4322-a432-bc564c30bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:00.442332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9f9ae-716a-4322-a432-bc564c30bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:00.442803 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9f9ae-716a-4322-a432-bc564c30bfa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.476866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:00.481725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ea58e-7fb1-4543-a559-5b87ce778042 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:00.547924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9f9ae-716a-4322-a432-bc564c30bfa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:00.549958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9f9ae-716a-4322-a432-bc564c30bfa5 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:00.566497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063701f9-b65f-431a-960a-6150b55aebfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:00.567471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063701f9-b65f-431a-960a-6150b55aebfc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:00.567955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063701f9-b65f-431a-960a-6150b55aebfc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:00.568601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063701f9-b65f-431a-960a-6150b55aebfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.569619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063701f9-b65f-431a-960a-6150b55aebfc None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=f98454c570304481a24ebb7a92189d26, user.id=c4cff41da8b84a87883a6878ed4555c6) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:00.570132 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063701f9-b65f-431a-960a-6150b55aebfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:00.571839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063701f9-b65f-431a-960a-6150b55aebfc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:00.577927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 49/92] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:00 2022] GET /identity/v3/role_assignments?user.id=c4cff41da8b84a87883a6878ed4555c6&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:00.579116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063701f9-b65f-431a-960a-6150b55aebfc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:00.741289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063701f9-b65f-431a-960a-6150b55aebfc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:00.767729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:00.780693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbae616-be3b-4b63-9b38-2f71e895ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:00.783952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbae616-be3b-4b63-9b38-2f71e895ded4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:00.783952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbae616-be3b-4b63-9b38-2f71e895ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:00.783952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbae616-be3b-4b63-9b38-2f71e895ded4 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:00.783952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbae616-be3b-4b63-9b38-2f71e895ded4 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:00.785384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbae616-be3b-4b63-9b38-2f71e895ded4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:00.790927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 50/93] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:00 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:00.797676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbae616-be3b-4b63-9b38-2f71e895ded4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:00.832229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 44/94] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:00.838052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9f9ae-716a-4322-a432-bc564c30bfa5 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:00.937025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:00.968947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbae616-be3b-4b63-9b38-2f71e895ded4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:01.033459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9f9ae-716a-4322-a432-bc564c30bfa5 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:01.038029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8a50-59d2-47f3-835e-f4a4b6e039e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:01.038720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8a50-59d2-47f3-835e-f4a4b6e039e3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:01.039012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8a50-59d2-47f3-835e-f4a4b6e039e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:01.039290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8a50-59d2-47f3-835e-f4a4b6e039e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:01.040103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8a50-59d2-47f3-835e-f4a4b6e039e3 None admin] RBAC: Adding query filter params (role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=f98454c570304481a24ebb7a92189d26, user.id=7ff0fdbd5cea443b8457e0eba48b93ac) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:01.040417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8a50-59d2-47f3-835e-f4a4b6e039e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:01.041912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8a50-59d2-47f3-835e-f4a4b6e039e3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:01.052508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 51/95] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:00 2022] GET /identity/v3/role_assignments?user.id=7ff0fdbd5cea443b8457e0eba48b93ac&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:01.110249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9706ef-d6a5-4c3d-ad86-41aa9d93c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:01.110844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9706ef-d6a5-4c3d-ad86-41aa9d93c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:01.111132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9706ef-d6a5-4c3d-ad86-41aa9d93c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:01.111451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9706ef-d6a5-4c3d-ad86-41aa9d93c2c2 None admin] PATH_INFO: `/v3/projects/3edd8847b2504659b5cf25790ebf2fb2` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:01.117760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9706ef-d6a5-4c3d-ad86-41aa9d93c2c2 None admin] RBAC: Authorizing `identity:get_project(project_id=3edd8847b2504659b5cf25790ebf2fb2)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:01.119323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9706ef-d6a5-4c3d-ad86-41aa9d93c2c2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:01.121187 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 45/96] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:00 2022] GET /identity/v3/projects/3edd8847b2504659b5cf25790ebf2fb2 => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:01.127847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8a50-59d2-47f3-835e-f4a4b6e039e3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:01.215310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:01.262777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8a50-59d2-47f3-835e-f4a4b6e039e3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:01.299446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7c0a8-335c-4093-95ca-d9a737539d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:01.300090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7c0a8-335c-4093-95ca-d9a737539d75 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:01.300375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7c0a8-335c-4093-95ca-d9a737539d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:01.300650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7c0a8-335c-4093-95ca-d9a737539d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:01.301494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7c0a8-335c-4093-95ca-d9a737539d75 None admin] RBAC: Adding query filter params (role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=3edd8847b2504659b5cf25790ebf2fb2, user.id=7ff0fdbd5cea443b8457e0eba48b93ac) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:01.301803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7c0a8-335c-4093-95ca-d9a737539d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:01.303280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7c0a8-335c-4093-95ca-d9a737539d75 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:01.309939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 52/97] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:01 2022] GET /identity/v3/role_assignments?user.id=7ff0fdbd5cea443b8457e0eba48b93ac&scope.project.id=3edd8847b2504659b5cf25790ebf2fb2&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:02.323453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276730d-23b9-4817-afef-545651eb36a5 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:02.324460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276730d-23b9-4817-afef-545651eb36a5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:02.325014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276730d-23b9-4817-afef-545651eb36a5 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:02.326578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 46/98] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:02.332484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ab9c-d453-4d70-92ec-74f2c2335483 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:02.333317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ab9c-d453-4d70-92ec-74f2c2335483 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:02.333814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ab9c-d453-4d70-92ec-74f2c2335483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:02.352671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7720ab9c-d453-4d70-92ec-74f2c2335483 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:02.354193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7720ab9c-d453-4d70-92ec-74f2c2335483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:02.422586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 53/99] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:02.445907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276730d-23b9-4817-afef-545651eb36a5 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:02.596988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276730d-23b9-4817-afef-545651eb36a5 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:02.612979 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:02.648247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedae91-cb8e-41b4-baee-77cb8ab7b928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:02.649557 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedae91-cb8e-41b4-baee-77cb8ab7b928 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:02.649910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedae91-cb8e-41b4-baee-77cb8ab7b928 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:02.650455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedae91-cb8e-41b4-baee-77cb8ab7b928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:02.651667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedae91-cb8e-41b4-baee-77cb8ab7b928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:02.653156 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedae91-cb8e-41b4-baee-77cb8ab7b928 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:02.655072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 47/100] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:02.661184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ab9c-d453-4d70-92ec-74f2c2335483 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:02.733815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:02.742711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4390-6785-45bb-b4e1-c54238b16bc7 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:02.744292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4390-6785-45bb-b4e1-c54238b16bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:02.744292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4390-6785-45bb-b4e1-c54238b16bc7 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:02.744955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 48/101] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:02.750006 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4090ef-f198-4089-9249-1b3e2b0fc14d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:02.750691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4090ef-f198-4089-9249-1b3e2b0fc14d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:02.752811 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4090ef-f198-4089-9249-1b3e2b0fc14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:02.786069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-5d4090ef-f198-4089-9249-1b3e2b0fc14d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:02.787787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5d4090ef-f198-4089-9249-1b3e2b0fc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:02.831524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ab9c-d453-4d70-92ec-74f2c2335483 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:02.890922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b678-b64d-4f0c-bd88-74855569997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:02.891949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b678-b64d-4f0c-bd88-74855569997f None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:02.892431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b678-b64d-4f0c-bd88-74855569997f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:02.893480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b678-b64d-4f0c-bd88-74855569997f None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:02.894374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760b678-b64d-4f0c-bd88-74855569997f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:02.896011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760b678-b64d-4f0c-bd88-74855569997f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:02.907849 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 49/102] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:02.910125 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d871b10-27ec-42a5-9561-b4526241129e None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:02.910648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d871b10-27ec-42a5-9561-b4526241129e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:02.911124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d871b10-27ec-42a5-9561-b4526241129e None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:02.912743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 50/103] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:02.931331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba03527-31ce-4955-b5b7-58f8f578f399 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:02.931929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba03527-31ce-4955-b5b7-58f8f578f399 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:02.932926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba03527-31ce-4955-b5b7-58f8f578f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:02.952987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-6ba03527-31ce-4955-b5b7-58f8f578f399 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:02.954485 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6ba03527-31ce-4955-b5b7-58f8f578f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:02.993838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 54/104] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:47:02 2022] POST /identity/v3/projects => generated 302 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:02.995025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b678-b64d-4f0c-bd88-74855569997f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:03.076123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 51/105] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:03.104527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba03527-31ce-4955-b5b7-58f8f578f399 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:03.149634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:03.192275 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:03.199057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b678-b64d-4f0c-bd88-74855569997f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:03.211926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba03527-31ce-4955-b5b7-58f8f578f399 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:03.248499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ebfae-01c2-48fc-ae46-71b4b9397cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:03.249102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ebfae-01c2-48fc-ae46-71b4b9397cfb None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:03.249390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ebfae-01c2-48fc-ae46-71b4b9397cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:03.249669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ebfae-01c2-48fc-ae46-71b4b9397cfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:03.261982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ebfae-01c2-48fc-ae46-71b4b9397cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-5b2ebfae-01c2-48fc-ae46-71b4b9397cfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:03.267077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:03.267982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:03.268727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 52/106] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:03.276766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ebfae-01c2-48fc-ae46-71b4b9397cfb None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:03.308807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8bbfd-7f34-464e-a645-5a467de2b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:03.309749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8bbfd-7f34-464e-a645-5a467de2b274 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:03.310041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8bbfd-7f34-464e-a645-5a467de2b274 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:03.310314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8bbfd-7f34-464e-a645-5a467de2b274 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:03.331343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8bbfd-7f34-464e-a645-5a467de2b274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-71a8bbfd-7f34-464e-a645-5a467de2b274 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:03.341622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:03.342890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:03.343659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:03.348311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 55/107] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:03.355692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8bbfd-7f34-464e-a645-5a467de2b274 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:03.453840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:03.458087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ebfae-01c2-48fc-ae46-71b4b9397cfb None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:03.523718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddefb4-6714-47e6-bd12-727191124e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:03.525471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddefb4-6714-47e6-bd12-727191124e25 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:03.526612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddefb4-6714-47e6-bd12-727191124e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:03.527278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddefb4-6714-47e6-bd12-727191124e25 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:03.529325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddefb4-6714-47e6-bd12-727191124e25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:03.530031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddefb4-6714-47e6-bd12-727191124e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:03.532521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddefb4-6714-47e6-bd12-727191124e25 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:03.544725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8bbfd-7f34-464e-a645-5a467de2b274 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:03.551119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 53/108] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:03.557031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddefb4-6714-47e6-bd12-727191124e25 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:03.634378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87f0fd-52cd-432a-afd4-b34a3885be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:03.635009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87f0fd-52cd-432a-afd4-b34a3885be0c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:03.635291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87f0fd-52cd-432a-afd4-b34a3885be0c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:03.635560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87f0fd-52cd-432a-afd4-b34a3885be0c None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:03.636288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87f0fd-52cd-432a-afd4-b34a3885be0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:03.636589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87f0fd-52cd-432a-afd4-b34a3885be0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:03.638112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87f0fd-52cd-432a-afd4-b34a3885be0c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:03.659885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 56/109] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:03.666238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87f0fd-52cd-432a-afd4-b34a3885be0c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:03.700839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:03.806438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddefb4-6714-47e6-bd12-727191124e25 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:03.833035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87f0fd-52cd-432a-afd4-b34a3885be0c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:03.895441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e8410-a697-47ef-8b9e-2c3af885679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:03.895669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd4be0-75ad-4121-adcd-3edab9945934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:03.896104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e8410-a697-47ef-8b9e-2c3af885679a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:03.896391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e8410-a697-47ef-8b9e-2c3af885679a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:03.896670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e8410-a697-47ef-8b9e-2c3af885679a None admin] PATH_INFO: `/v3/users/83768e0e54a2455eb3b7b60ea6aecf34` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:03.897232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4be0-75ad-4121-adcd-3edab9945934 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:03.897731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4be0-75ad-4121-adcd-3edab9945934 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:03.898198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4be0-75ad-4121-adcd-3edab9945934 None admin] PATH_INFO: `/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:03.899602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd4be0-75ad-4121-adcd-3edab9945934 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff0fdbd5cea443b8457e0eba48b93ac)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:03.901313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd4be0-75ad-4121-adcd-3edab9945934 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:03.903138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 54/110] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:03 2022] GET /identity/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac => generated 275 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:03.909686 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd4be0-75ad-4121-adcd-3edab9945934 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:03.929513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e8410-a697-47ef-8b9e-2c3af885679a None admin] RBAC: Authorizing `identity:get_user(user_id=83768e0e54a2455eb3b7b60ea6aecf34)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:03.931028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e8410-a697-47ef-8b9e-2c3af885679a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:03.932937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 57/111] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:03 2022] GET /identity/v3/users/83768e0e54a2455eb3b7b60ea6aecf34 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:03.938848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e8410-a697-47ef-8b9e-2c3af885679a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:03.973629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:04.100932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd4be0-75ad-4121-adcd-3edab9945934 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:04.112029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:04.137585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093180a9-f360-425a-912c-fccab3a7a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:04.138365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e8410-a697-47ef-8b9e-2c3af885679a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:04.138472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093180a9-f360-425a-912c-fccab3a7a41b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.138800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093180a9-f360-425a-912c-fccab3a7a41b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.139147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093180a9-f360-425a-912c-fccab3a7a41b None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.140410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093180a9-f360-425a-912c-fccab3a7a41b None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:04.142370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093180a9-f360-425a-912c-fccab3a7a41b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:04.144196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 55/112] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:03 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:04.145727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f31e4-386f-4481-b2e9-bd88367b88cd None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.146018 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f31e4-386f-4481-b2e9-bd88367b88cd None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.146294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f31e4-386f-4481-b2e9-bd88367b88cd None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.147824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 56/113] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:04.152109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0394bc-7285-4cc9-a46a-e2668af09b90 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.152400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0394bc-7285-4cc9-a46a-e2668af09b90 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.152677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0394bc-7285-4cc9-a46a-e2668af09b90 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.154122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 57/114] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:04.154982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7248bb-2766-4b3b-b638-c31e235761e8 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.155264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7248bb-2766-4b3b-b638-c31e235761e8 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.155535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7248bb-2766-4b3b-b638-c31e235761e8 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.156873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 58/115] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:04.157407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7248bb-2766-4b3b-b638-c31e235761e8 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:04.185041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4cceb-6626-44cd-88f1-cf49b0999a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:04.185672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4cceb-6626-44cd-88f1-cf49b0999a69 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.185956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4cceb-6626-44cd-88f1-cf49b0999a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.186228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4cceb-6626-44cd-88f1-cf49b0999a69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.257359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4cceb-6626-44cd-88f1-cf49b0999a69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:04.258844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4cceb-6626-44cd-88f1-cf49b0999a69 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:04.266499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:04.271636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7248bb-2766-4b3b-b638-c31e235761e8 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:04.309243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd361f-e344-4977-a98b-6ce6618bd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:04.310314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd361f-e344-4977-a98b-6ce6618bd881 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.310591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd361f-e344-4977-a98b-6ce6618bd881 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.310871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd361f-e344-4977-a98b-6ce6618bd881 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26/users/7ff0fdbd5cea443b8457e0eba48b93ac/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.312833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd361f-e344-4977-a98b-6ce6618bd881 None admin] RBAC: Authorizing `identity:create_grant(project_id=f98454c570304481a24ebb7a92189d26, user_id=7ff0fdbd5cea443b8457e0eba48b93ac, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:04.314285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd361f-e344-4977-a98b-6ce6618bd881 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:04.343080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:04.362436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 58/116] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:04.363620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4fec6-63dc-432a-9bd2-81016384e44d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.363906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4fec6-63dc-432a-9bd2-81016384e44d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.364189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4fec6-63dc-432a-9bd2-81016384e44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.381817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cdb4fec6-63dc-432a-9bd2-81016384e44d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:04.383016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cdb4fec6-63dc-432a-9bd2-81016384e44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:04.396821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 59/117] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:47:04 2022] PUT /identity/v3/projects/f98454c570304481a24ebb7a92189d26/users/7ff0fdbd5cea443b8457e0eba48b93ac/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:04.396821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ffb3d-8074-4136-ad83-0014e4e5131e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.396821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ffb3d-8074-4136-ad83-0014e4e5131e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.396821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ffb3d-8074-4136-ad83-0014e4e5131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.414768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-d27ffb3d-8074-4136-ad83-0014e4e5131e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:04.416025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d27ffb3d-8074-4136-ad83-0014e4e5131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:04.484956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 59/118] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:04.486989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647f32d-3235-433a-a4f4-e4dcc9a91e4f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.487371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647f32d-3235-433a-a4f4-e4dcc9a91e4f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.487656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647f32d-3235-433a-a4f4-e4dcc9a91e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.500693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 60/119] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:04.509671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ffb3d-8074-4136-ad83-0014e4e5131e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:04.532495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8647f32d-3235-433a-a4f4-e4dcc9a91e4f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:04.533857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8647f32d-3235-433a-a4f4-e4dcc9a91e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:04.635074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 60/120] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:04.636326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647f32d-3235-433a-a4f4-e4dcc9a91e4f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:04.649712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:04.665192 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ffb3d-8074-4136-ad83-0014e4e5131e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:04.707710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:04.711631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ad4c0-8963-4fdd-8ea6-67e1954ed859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:04.712290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ad4c0-8963-4fdd-8ea6-67e1954ed859 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.712572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ad4c0-8963-4fdd-8ea6-67e1954ed859 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.712919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ad4c0-8963-4fdd-8ea6-67e1954ed859 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.714681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ad4c0-8963-4fdd-8ea6-67e1954ed859 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:04.716713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ad4c0-8963-4fdd-8ea6-67e1954ed859 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:04.724554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 61/121] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:04 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:04.724554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ad4c0-8963-4fdd-8ea6-67e1954ed859 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:04.777967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647f32d-3235-433a-a4f4-e4dcc9a91e4f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:04.815419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea58fd2-c077-492d-82df-e1a6e6c7f7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:04.816498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea58fd2-c077-492d-82df-e1a6e6c7f7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.816999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea58fd2-c077-492d-82df-e1a6e6c7f7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.817488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea58fd2-c077-492d-82df-e1a6e6c7f7e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.828347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea58fd2-c077-492d-82df-e1a6e6c7f7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-eea58fd2-c077-492d-82df-e1a6e6c7f7e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:04.842637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:04.843613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:04.844364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:04.844998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ad4c0-8963-4fdd-8ea6-67e1954ed859 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:04.847920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 61/122] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:04.848986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea58fd2-c077-492d-82df-e1a6e6c7f7e5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:04.890827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912c1f-adfa-4eb7-b17e-82a759598e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:04.891834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912c1f-adfa-4eb7-b17e-82a759598e5d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:04.893236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912c1f-adfa-4eb7-b17e-82a759598e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:04.893728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f912c1f-adfa-4eb7-b17e-82a759598e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:04.910182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f912c1f-adfa-4eb7-b17e-82a759598e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-8f912c1f-adfa-4eb7-b17e-82a759598e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:04.917437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:04.918508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:04.919370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:04.926435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 62/123] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:04.927831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912c1f-adfa-4eb7-b17e-82a759598e5d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:04.952428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:04.977919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:04.981263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea58fd2-c077-492d-82df-e1a6e6c7f7e5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.015659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56995-8bb8-4f0e-a97b-2355864ede98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.016168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56995-8bb8-4f0e-a97b-2355864ede98 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.016458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56995-8bb8-4f0e-a97b-2355864ede98 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.016736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56995-8bb8-4f0e-a97b-2355864ede98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.028858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e56995-8bb8-4f0e-a97b-2355864ede98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-94e56995-8bb8-4f0e-a97b-2355864ede98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:05.034337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:05.035207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 62/124] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:05.036386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56995-8bb8-4f0e-a97b-2355864ede98 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.051269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f912c1f-adfa-4eb7-b17e-82a759598e5d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.088929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14379c-12d4-4336-af3f-2b9a2edb5855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.089924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14379c-12d4-4336-af3f-2b9a2edb5855 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.090402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14379c-12d4-4336-af3f-2b9a2edb5855 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.090871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14379c-12d4-4336-af3f-2b9a2edb5855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.091933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14379c-12d4-4336-af3f-2b9a2edb5855 None admin] RBAC: Adding query filter params (role.id=cfeca18af06d4545b5672877734062d7, scope.project.id=f98454c570304481a24ebb7a92189d26, user.id=83768e0e54a2455eb3b7b60ea6aecf34) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:05.092451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14379c-12d4-4336-af3f-2b9a2edb5855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.094145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14379c-12d4-4336-af3f-2b9a2edb5855 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.100236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 63/125] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:04 2022] GET /identity/v3/role_assignments?user.id=83768e0e54a2455eb3b7b60ea6aecf34&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=cfeca18af06d4545b5672877734062d7 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.101561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14379c-12d4-4336-af3f-2b9a2edb5855 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.145994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56995-8bb8-4f0e-a97b-2355864ede98 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.183025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f219-395d-4078-ac7c-3b516914e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.183665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f219-395d-4078-ac7c-3b516914e5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.183950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f219-395d-4078-ac7c-3b516914e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.184224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f219-395d-4078-ac7c-3b516914e5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.185266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f219-395d-4078-ac7c-3b516914e5a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:05.185627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f219-395d-4078-ac7c-3b516914e5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.187143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f219-395d-4078-ac7c-3b516914e5a5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.195904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:05.197073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 63/126] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.197891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f219-395d-4078-ac7c-3b516914e5a5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.218825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14379c-12d4-4336-af3f-2b9a2edb5855 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.230399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:05.259300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9066f-2af5-44d7-b478-e474d7db0dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.260308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9066f-2af5-44d7-b478-e474d7db0dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.260847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9066f-2af5-44d7-b478-e474d7db0dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.261342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9066f-2af5-44d7-b478-e474d7db0dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.262278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9066f-2af5-44d7-b478-e474d7db0dc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:05.262784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9066f-2af5-44d7-b478-e474d7db0dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.264655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9066f-2af5-44d7-b478-e474d7db0dc0 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.279564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 64/127] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.280988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9066f-2af5-44d7-b478-e474d7db0dc0 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.316212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f219-395d-4078-ac7c-3b516914e5a5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.353376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ea257-1a61-4bea-9c43-75b4c90b9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.354027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea257-1a61-4bea-9c43-75b4c90b9f84 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.354284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea257-1a61-4bea-9c43-75b4c90b9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.354559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea257-1a61-4bea-9c43-75b4c90b9f84 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.355298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ea257-1a61-4bea-9c43-75b4c90b9f84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:05.355950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ea257-1a61-4bea-9c43-75b4c90b9f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.357001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ea257-1a61-4bea-9c43-75b4c90b9f84 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.366802 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 64/128] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.367678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ea257-1a61-4bea-9c43-75b4c90b9f84 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.394535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9066f-2af5-44d7-b478-e474d7db0dc0 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.434928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064689e8-740a-4c72-8b91-0e5597a3ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.435966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064689e8-740a-4c72-8b91-0e5597a3ea1f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.436446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064689e8-740a-4c72-8b91-0e5597a3ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.436978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064689e8-740a-4c72-8b91-0e5597a3ea1f None admin] PATH_INFO: `/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.438356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064689e8-740a-4c72-8b91-0e5597a3ea1f None admin] RBAC: Authorizing `identity:get_user(user_id=7ff0fdbd5cea443b8457e0eba48b93ac)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.440096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064689e8-740a-4c72-8b91-0e5597a3ea1f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.442997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 65/129] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:05 2022] GET /identity/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.443980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064689e8-740a-4c72-8b91-0e5597a3ea1f None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.458163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:05.462918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:05.479252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ea257-1a61-4bea-9c43-75b4c90b9f84 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.518278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c42eb-c859-42ac-9c2b-8120fa9b6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.518929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c42eb-c859-42ac-9c2b-8120fa9b6baf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.519214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c42eb-c859-42ac-9c2b-8120fa9b6baf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.519493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c42eb-c859-42ac-9c2b-8120fa9b6baf None admin] PATH_INFO: `/v3/users/c4cff41da8b84a87883a6878ed4555c6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.520862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c42eb-c859-42ac-9c2b-8120fa9b6baf None admin] RBAC: Authorizing `identity:get_user(user_id=c4cff41da8b84a87883a6878ed4555c6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.522312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c42eb-c859-42ac-9c2b-8120fa9b6baf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.530620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 65/130] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:05 2022] GET /identity/v3/users/c4cff41da8b84a87883a6878ed4555c6 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.530620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c42eb-c859-42ac-9c2b-8120fa9b6baf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.586776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064689e8-740a-4c72-8b91-0e5597a3ea1f None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.665354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d84fd-7b00-4d55-834c-ce2da8f04cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.666029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d84fd-7b00-4d55-834c-ce2da8f04cee None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.666320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d84fd-7b00-4d55-834c-ce2da8f04cee None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.666600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d84fd-7b00-4d55-834c-ce2da8f04cee None admin] PATH_INFO: `/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.667932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d84fd-7b00-4d55-834c-ce2da8f04cee None admin] RBAC: Authorizing `identity:get_user(user_id=7ff0fdbd5cea443b8457e0eba48b93ac)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.669568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d84fd-7b00-4d55-834c-ce2da8f04cee None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.671605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 66/131] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:05 2022] GET /identity/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.672523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d84fd-7b00-4d55-834c-ce2da8f04cee None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.691195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c42eb-c859-42ac-9c2b-8120fa9b6baf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.724609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f744a-b3e8-4d21-8763-e4f6171ebef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.725294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f744a-b3e8-4d21-8763-e4f6171ebef0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.725579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f744a-b3e8-4d21-8763-e4f6171ebef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.725859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f744a-b3e8-4d21-8763-e4f6171ebef0 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.727028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f744a-b3e8-4d21-8763-e4f6171ebef0 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.728493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f744a-b3e8-4d21-8763-e4f6171ebef0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.730843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 66/132] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:05 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.732061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29f406-b805-4060-b324-d3ac1d780014 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.732353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29f406-b805-4060-b324-d3ac1d780014 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.732666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29f406-b805-4060-b324-d3ac1d780014 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.733968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 67/133] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:05.734666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29f406-b805-4060-b324-d3ac1d780014 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.761199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:05.783912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:05.818386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d84fd-7b00-4d55-834c-ce2da8f04cee None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.849147 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29f406-b805-4060-b324-d3ac1d780014 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:05.862008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ce07c-9d53-4896-a6c2-c13befb48cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.862665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ce07c-9d53-4896-a6c2-c13befb48cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.863090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ce07c-9d53-4896-a6c2-c13befb48cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.863378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ce07c-9d53-4896-a6c2-c13befb48cb1 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.864575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ce07c-9d53-4896-a6c2-c13befb48cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.866070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ce07c-9d53-4896-a6c2-c13befb48cb1 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.872563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 67/134] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:05 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.873869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b6935-3de9-4825-8e55-7d4194124a36 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.874155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b6935-3de9-4825-8e55-7d4194124a36 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.874435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b6935-3de9-4825-8e55-7d4194124a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.884822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca27aa-ddb9-4e1e-95e4-aa9aa02b9adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:05.885475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca27aa-ddb9-4e1e-95e4-aa9aa02b9adb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:05.885761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca27aa-ddb9-4e1e-95e4-aa9aa02b9adb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:05.886036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca27aa-ddb9-4e1e-95e4-aa9aa02b9adb None admin] PATH_INFO: `/v3/projects/3edd8847b2504659b5cf25790ebf2fb2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:05.887201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca27aa-ddb9-4e1e-95e4-aa9aa02b9adb None admin] RBAC: Authorizing `identity:get_project(project_id=3edd8847b2504659b5cf25790ebf2fb2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:05.888811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca27aa-ddb9-4e1e-95e4-aa9aa02b9adb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:05.890973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 68/135] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:05 2022] GET /identity/v3/projects/3edd8847b2504659b5cf25790ebf2fb2 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:05.891667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca27aa-ddb9-4e1e-95e4-aa9aa02b9adb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:05.894061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-747b6935-3de9-4825-8e55-7d4194124a36 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:05.895292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-747b6935-3de9-4825-8e55-7d4194124a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:05.970452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 68/136] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:05.971408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b6935-3de9-4825-8e55-7d4194124a36 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:06.001206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:06.020477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca27aa-ddb9-4e1e-95e4-aa9aa02b9adb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:06.057519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:06.066406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aaf21-1fa4-4be4-b4a0-cb4d8093fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:06.067420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aaf21-1fa4-4be4-b4a0-cb4d8093fa8b None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:06.068124 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aaf21-1fa4-4be4-b4a0-cb4d8093fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:06.068559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aaf21-1fa4-4be4-b4a0-cb4d8093fa8b None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26/users/7ff0fdbd5cea443b8457e0eba48b93ac/roles/5f8cf1f7cff749478558197b9f9ba38d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:06.071490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aaf21-1fa4-4be4-b4a0-cb4d8093fa8b None admin] RBAC: Authorizing `identity:create_grant(project_id=f98454c570304481a24ebb7a92189d26, user_id=7ff0fdbd5cea443b8457e0eba48b93ac, role_id=5f8cf1f7cff749478558197b9f9ba38d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:06.073470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aaf21-1fa4-4be4-b4a0-cb4d8093fa8b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:06.084031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b6935-3de9-4825-8e55-7d4194124a36 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:06.120351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71cc13-9cbf-4db0-9d4e-220134ab6bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:06.121196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71cc13-9cbf-4db0-9d4e-220134ab6bf9 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:06.121551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71cc13-9cbf-4db0-9d4e-220134ab6bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:06.121897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71cc13-9cbf-4db0-9d4e-220134ab6bf9 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26/users/c4cff41da8b84a87883a6878ed4555c6/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:06.123871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71cc13-9cbf-4db0-9d4e-220134ab6bf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f98454c570304481a24ebb7a92189d26, user_id=c4cff41da8b84a87883a6878ed4555c6, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:06.125452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71cc13-9cbf-4db0-9d4e-220134ab6bf9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:06.209352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 69/137] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:47:05 2022] PUT /identity/v3/projects/f98454c570304481a24ebb7a92189d26/users/7ff0fdbd5cea443b8457e0eba48b93ac/roles/5f8cf1f7cff749478558197b9f9ba38d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:06.210048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aaf21-1fa4-4be4-b4a0-cb4d8093fa8b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:06.281088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 69/138] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:47:05 2022] PUT /identity/v3/projects/f98454c570304481a24ebb7a92189d26/users/c4cff41da8b84a87883a6878ed4555c6/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:06.285896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71cc13-9cbf-4db0-9d4e-220134ab6bf9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:06.396061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aaf21-1fa4-4be4-b4a0-cb4d8093fa8b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:06.433471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef933b6-331d-4790-bb37-e142b3bf7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:06.434165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef933b6-331d-4790-bb37-e142b3bf7b82 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:06.434749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef933b6-331d-4790-bb37-e142b3bf7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:06.435031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef933b6-331d-4790-bb37-e142b3bf7b82 None admin] PATH_INFO: `/v3/projects/3edd8847b2504659b5cf25790ebf2fb2/users/7ff0fdbd5cea443b8457e0eba48b93ac/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:06.437108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef933b6-331d-4790-bb37-e142b3bf7b82 None admin] RBAC: Authorizing `identity:create_grant(project_id=3edd8847b2504659b5cf25790ebf2fb2, user_id=7ff0fdbd5cea443b8457e0eba48b93ac, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:06.438594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef933b6-331d-4790-bb37-e142b3bf7b82 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:06.463896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71cc13-9cbf-4db0-9d4e-220134ab6bf9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:06.519041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257b05b-3f42-4d85-8f10-0d4b93ec5ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:06.519709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257b05b-3f42-4d85-8f10-0d4b93ec5ded None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:06.519993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257b05b-3f42-4d85-8f10-0d4b93ec5ded None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:06.520268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257b05b-3f42-4d85-8f10-0d4b93ec5ded None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:06.523824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257b05b-3f42-4d85-8f10-0d4b93ec5ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:06.525573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257b05b-3f42-4d85-8f10-0d4b93ec5ded None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:06.527696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 70/139] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:06.533763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257b05b-3f42-4d85-8f10-0d4b93ec5ded None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:06.549102 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 70/140] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:47:06 2022] PUT /identity/v3/projects/3edd8847b2504659b5cf25790ebf2fb2/users/7ff0fdbd5cea443b8457e0eba48b93ac/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:06.550145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:06.672044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257b05b-3f42-4d85-8f10-0d4b93ec5ded None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:06.724975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1b0d-539e-43c9-8b3e-016ab05d8dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:06.725637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1b0d-539e-43c9-8b3e-016ab05d8dda None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:06.725923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1b0d-539e-43c9-8b3e-016ab05d8dda None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:06.726215 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1b0d-539e-43c9-8b3e-016ab05d8dda None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:06.726939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1b0d-539e-43c9-8b3e-016ab05d8dda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:06.728449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1b0d-539e-43c9-8b3e-016ab05d8dda None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:06.850890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 71/141] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:06 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:06.919558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5306d1-0844-4ffb-9d4a-e99642560613 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:06.919844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5306d1-0844-4ffb-9d4a-e99642560613 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:06.920125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5306d1-0844-4ffb-9d4a-e99642560613 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:06.921666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 71/142] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:06.927645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac3a0-cbb8-4dc4-802e-0c61ee08baab None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:06.927996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac3a0-cbb8-4dc4-802e-0c61ee08baab None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:06.928283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ac3a0-cbb8-4dc4-802e-0c61ee08baab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:06.957996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-4f0ac3a0-cbb8-4dc4-802e-0c61ee08baab None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:06.959231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4f0ac3a0-cbb8-4dc4-802e-0c61ee08baab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:07.036857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:07.050635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 72/143] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:07.077013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5306d1-0844-4ffb-9d4a-e99642560613 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:07.088932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:07.191864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5306d1-0844-4ffb-9d4a-e99642560613 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:07.234078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939d492-ead5-4f12-b0db-d449eabb51ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:07.234735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939d492-ead5-4f12-b0db-d449eabb51ec None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:07.235022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939d492-ead5-4f12-b0db-d449eabb51ec None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:07.235297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939d492-ead5-4f12-b0db-d449eabb51ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:07.253722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939d492-ead5-4f12-b0db-d449eabb51ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-6939d492-ead5-4f12-b0db-d449eabb51ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:07.259320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:07.260374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:07.261354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 72/144] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:07.268325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ac3a0-cbb8-4dc4-802e-0c61ee08baab None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:07.382202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ac3a0-cbb8-4dc4-802e-0c61ee08baab None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:07.425825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae41b6-0331-48bf-8fce-d924dbac38e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:07.426375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae41b6-0331-48bf-8fce-d924dbac38e7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:07.426656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae41b6-0331-48bf-8fce-d924dbac38e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:07.426930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae41b6-0331-48bf-8fce-d924dbac38e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:07.427652 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae41b6-0331-48bf-8fce-d924dbac38e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:07.427953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae41b6-0331-48bf-8fce-d924dbac38e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:07.429418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae41b6-0331-48bf-8fce-d924dbac38e7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:07.440221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 73/145] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:07.445551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939d492-ead5-4f12-b0db-d449eabb51ec None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:07.526488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:07.563911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939d492-ead5-4f12-b0db-d449eabb51ec None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:07.604964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506152f9-6d10-4be0-89a9-7bf778414082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:07.605618 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506152f9-6d10-4be0-89a9-7bf778414082 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:07.605895 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506152f9-6d10-4be0-89a9-7bf778414082 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:07.606166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506152f9-6d10-4be0-89a9-7bf778414082 None admin] PATH_INFO: `/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:07.608264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506152f9-6d10-4be0-89a9-7bf778414082 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff0fdbd5cea443b8457e0eba48b93ac)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:07.609756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506152f9-6d10-4be0-89a9-7bf778414082 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:07.612197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 73/146] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:07 2022] GET /identity/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:07.617952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae41b6-0331-48bf-8fce-d924dbac38e7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:07.713352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:07.773742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae41b6-0331-48bf-8fce-d924dbac38e7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:07.809796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b7f6-73fd-4be2-aab0-38949d5830f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:07.810770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b7f6-73fd-4be2-aab0-38949d5830f3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:07.811243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b7f6-73fd-4be2-aab0-38949d5830f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:07.811707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b7f6-73fd-4be2-aab0-38949d5830f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:07.883561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4b7f6-73fd-4be2-aab0-38949d5830f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:07.885391 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4b7f6-73fd-4be2-aab0-38949d5830f3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:07.944257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:07.997830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 74/147] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:08.003403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506152f9-6d10-4be0-89a9-7bf778414082 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:08.079071 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9edbd-bda6-4ff4-a76c-b2a9bfbd4936 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:08.079385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9edbd-bda6-4ff4-a76c-b2a9bfbd4936 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:08.079627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9edbd-bda6-4ff4-a76c-b2a9bfbd4936 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:08.081368 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 75/148] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:08.086213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b85b6-95dd-42b9-a14b-b9da786b71cc None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:08.086543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b85b6-95dd-42b9-a14b-b9da786b71cc None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:08.086831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b85b6-95dd-42b9-a14b-b9da786b71cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:08.119452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a18b85b6-95dd-42b9-a14b-b9da786b71cc None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:08.120658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a18b85b6-95dd-42b9-a14b-b9da786b71cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:08.125262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506152f9-6d10-4be0-89a9-7bf778414082 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:08.180814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e93efc-c346-46f6-935b-bab830772f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:08.180814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e93efc-c346-46f6-935b-bab830772f53 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:08.180814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e93efc-c346-46f6-935b-bab830772f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:08.180814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e93efc-c346-46f6-935b-bab830772f53 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:08.182096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e93efc-c346-46f6-935b-bab830772f53 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:08.183869 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e93efc-c346-46f6-935b-bab830772f53 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:08.186778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 74/149] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:08 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:08.192926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e93efc-c346-46f6-935b-bab830772f53 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:08.196797 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:08.316214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e93efc-c346-46f6-935b-bab830772f53 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:08.318497 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 76/150] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:08.354929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b85b6-95dd-42b9-a14b-b9da786b71cc None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:08.356486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b4480-5fb1-4764-a93b-29b3e7fb1e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:08.357148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b4480-5fb1-4764-a93b-29b3e7fb1e98 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:08.357430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b4480-5fb1-4764-a93b-29b3e7fb1e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:08.357701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b4480-5fb1-4764-a93b-29b3e7fb1e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:08.358498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b4480-5fb1-4764-a93b-29b3e7fb1e98 None admin] RBAC: Adding query filter params (role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=f98454c570304481a24ebb7a92189d26, user.id=7ff0fdbd5cea443b8457e0eba48b93ac) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:08.358805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b4480-5fb1-4764-a93b-29b3e7fb1e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:08.360244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b4480-5fb1-4764-a93b-29b3e7fb1e98 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:08.367135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 75/151] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:08 2022] GET /identity/v3/role_assignments?user.id=7ff0fdbd5cea443b8457e0eba48b93ac&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:08.476014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:08.501210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b85b6-95dd-42b9-a14b-b9da786b71cc None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:08.544926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11881366-3553-47ba-8492-1659ec29f664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:08.545594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11881366-3553-47ba-8492-1659ec29f664 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:08.545874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11881366-3553-47ba-8492-1659ec29f664 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:08.546146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11881366-3553-47ba-8492-1659ec29f664 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:08.560524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11881366-3553-47ba-8492-1659ec29f664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-11881366-3553-47ba-8492-1659ec29f664 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:08.565567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:08.566445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:08.567213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:08.568972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 77/152] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:08.577995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b4480-5fb1-4764-a93b-29b3e7fb1e98 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:08.684285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:08.725254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b4480-5fb1-4764-a93b-29b3e7fb1e98 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:08.763630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9c5f1-e5bd-4527-84b8-68bc05bba715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:08.764263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9c5f1-e5bd-4527-84b8-68bc05bba715 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:08.764524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9c5f1-e5bd-4527-84b8-68bc05bba715 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:08.764826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9c5f1-e5bd-4527-84b8-68bc05bba715 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:08.765592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9c5f1-e5bd-4527-84b8-68bc05bba715 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:08.765898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9c5f1-e5bd-4527-84b8-68bc05bba715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:08.767285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9c5f1-e5bd-4527-84b8-68bc05bba715 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:08.780578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 76/153] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:08.787018 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11881366-3553-47ba-8492-1659ec29f664 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:08.924727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11881366-3553-47ba-8492-1659ec29f664 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:08.964185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6539a-ff7c-4394-b721-bd1677995f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:08.964841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6539a-ff7c-4394-b721-bd1677995f93 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:08.965121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6539a-ff7c-4394-b721-bd1677995f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:08.965389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6539a-ff7c-4394-b721-bd1677995f93 None admin] PATH_INFO: `/v3/users/83768e0e54a2455eb3b7b60ea6aecf34` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:08.966564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6539a-ff7c-4394-b721-bd1677995f93 None admin] RBAC: Authorizing `identity:get_user(user_id=83768e0e54a2455eb3b7b60ea6aecf34)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:08.968019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6539a-ff7c-4394-b721-bd1677995f93 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:08.969830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 78/154] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:08 2022] GET /identity/v3/users/83768e0e54a2455eb3b7b60ea6aecf34 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:08.976262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9c5f1-e5bd-4527-84b8-68bc05bba715 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:09.115517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9c5f1-e5bd-4527-84b8-68bc05bba715 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:09.152862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:09.158806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb698b8d-e9f5-4673-9477-c32630f4611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:09.159463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698b8d-e9f5-4673-9477-c32630f4611a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.159747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698b8d-e9f5-4673-9477-c32630f4611a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.160022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698b8d-e9f5-4673-9477-c32630f4611a None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.161259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb698b8d-e9f5-4673-9477-c32630f4611a None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:09.164400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb698b8d-e9f5-4673-9477-c32630f4611a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:09.164616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 77/155] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:08 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:09.178017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6539a-ff7c-4394-b721-bd1677995f93 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:09.198937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:09.332834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6539a-ff7c-4394-b721-bd1677995f93 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:09.375297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6af80-e0d3-4860-90d0-37f156f56df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:09.375967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6af80-e0d3-4860-90d0-37f156f56df2 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.376242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6af80-e0d3-4860-90d0-37f156f56df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.376512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6af80-e0d3-4860-90d0-37f156f56df2 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26/users/83768e0e54a2455eb3b7b60ea6aecf34/roles/cfeca18af06d4545b5672877734062d7` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.382060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6af80-e0d3-4860-90d0-37f156f56df2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f98454c570304481a24ebb7a92189d26, user_id=83768e0e54a2455eb3b7b60ea6aecf34, role_id=cfeca18af06d4545b5672877734062d7)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:09.383517 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6af80-e0d3-4860-90d0-37f156f56df2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:09.391264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91f905-8f7b-4e9b-9809-38c97c2ac32f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.391580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91f905-8f7b-4e9b-9809-38c97c2ac32f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.391829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91f905-8f7b-4e9b-9809-38c97c2ac32f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.393397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 78/156] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:09.401009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c966f0a-6daf-4d28-9aa2-c48001a11e0d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.401300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c966f0a-6daf-4d28-9aa2-c48001a11e0d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.401577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c966f0a-6daf-4d28-9aa2-c48001a11e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.437839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4c966f0a-6daf-4d28-9aa2-c48001a11e0d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:09.438982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4c966f0a-6daf-4d28-9aa2-c48001a11e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:09.455577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 79/157] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:47:09 2022] PUT /identity/v3/projects/f98454c570304481a24ebb7a92189d26/users/83768e0e54a2455eb3b7b60ea6aecf34/roles/cfeca18af06d4545b5672877734062d7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:09.543289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 79/158] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 17:47:09.578393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6af80-e0d3-4860-90d0-37f156f56df2 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:09.678343 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:09.710595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6efa2-0e2c-4435-883f-798367bd4e82 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.711082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6efa2-0e2c-4435-883f-798367bd4e82 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.711082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6efa2-0e2c-4435-883f-798367bd4e82 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.713899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 80/159] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:09.718109 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc21f76-525c-4c56-a6a0-36779fc44555 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.718390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc21f76-525c-4c56-a6a0-36779fc44555 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.718667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc21f76-525c-4c56-a6a0-36779fc44555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.724255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6af80-e0d3-4860-90d0-37f156f56df2 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:09.761808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-efc21f76-525c-4c56-a6a0-36779fc44555 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:09.763004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-efc21f76-525c-4c56-a6a0-36779fc44555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:09.768475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886578f0-5697-49af-8ccd-c8b12fbf076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:09.769522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886578f0-5697-49af-8ccd-c8b12fbf076e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:09.770058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886578f0-5697-49af-8ccd-c8b12fbf076e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:09.770525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886578f0-5697-49af-8ccd-c8b12fbf076e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:09.791602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886578f0-5697-49af-8ccd-c8b12fbf076e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-886578f0-5697-49af-8ccd-c8b12fbf076e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:09.797580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:09.798522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:09.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:09.802312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 80/160] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:09.816428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886578f0-5697-49af-8ccd-c8b12fbf076e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:09.923064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 81/161] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:09.990544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886578f0-5697-49af-8ccd-c8b12fbf076e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:09.994721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc21f76-525c-4c56-a6a0-36779fc44555 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:10.071154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:10.093498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d2b59-05ae-4170-9ed4-60bc1bf65578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:10.094131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d2b59-05ae-4170-9ed4-60bc1bf65578 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:10.094411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d2b59-05ae-4170-9ed4-60bc1bf65578 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:10.094686 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d2b59-05ae-4170-9ed4-60bc1bf65578 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:10.100816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d2b59-05ae-4170-9ed4-60bc1bf65578 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:10.100816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d2b59-05ae-4170-9ed4-60bc1bf65578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:10.100816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d2b59-05ae-4170-9ed4-60bc1bf65578 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:10.103503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:10.111885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 81/162] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:10.117462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d2b59-05ae-4170-9ed4-60bc1bf65578 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:10.191348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc21f76-525c-4c56-a6a0-36779fc44555 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:10.250778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0aab9-274d-4293-a7fb-ef1d8721cf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:10.251702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0aab9-274d-4293-a7fb-ef1d8721cf52 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:10.252678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0aab9-274d-4293-a7fb-ef1d8721cf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:10.253163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0aab9-274d-4293-a7fb-ef1d8721cf52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:10.276828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0aab9-274d-4293-a7fb-ef1d8721cf52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a8f0aab9-274d-4293-a7fb-ef1d8721cf52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:10.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:10.283715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:10.284480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:10.286849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 82/163] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:10.296974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0aab9-274d-4293-a7fb-ef1d8721cf52 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:10.387124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d2b59-05ae-4170-9ed4-60bc1bf65578 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:10.416906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0aab9-274d-4293-a7fb-ef1d8721cf52 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:10.442476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:10.453765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b7dc5-7684-49a8-81f5-d2ebef6bf31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:10.458429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b7dc5-7684-49a8-81f5-d2ebef6bf31c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:10.458429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b7dc5-7684-49a8-81f5-d2ebef6bf31c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:10.458429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b7dc5-7684-49a8-81f5-d2ebef6bf31c None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:10.458429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b7dc5-7684-49a8-81f5-d2ebef6bf31c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:10.458429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b7dc5-7684-49a8-81f5-d2ebef6bf31c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:10.458429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b7dc5-7684-49a8-81f5-d2ebef6bf31c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:10.468276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 83/164] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:10.470105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e224-02d3-443b-97d9-7a042ec9d405 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:10.470650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e224-02d3-443b-97d9-7a042ec9d405 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:10.471284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e224-02d3-443b-97d9-7a042ec9d405 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:10.476895 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 84/165] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:10.476895 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e224-02d3-443b-97d9-7a042ec9d405 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:10.477734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace2a2c-5320-45f2-a2d9-5cea89763c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:10.478387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2a2c-5320-45f2-a2d9-5cea89763c17 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:10.478663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2a2c-5320-45f2-a2d9-5cea89763c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:10.478937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2a2c-5320-45f2-a2d9-5cea89763c17 None admin] PATH_INFO: `/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:10.480159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace2a2c-5320-45f2-a2d9-5cea89763c17 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff0fdbd5cea443b8457e0eba48b93ac)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:10.482117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace2a2c-5320-45f2-a2d9-5cea89763c17 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:10.483726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 82/166] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:10 2022] GET /identity/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac => generated 275 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:10.488405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd156a2-fc3d-4e8b-bfc6-22891b477289 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:10.488684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd156a2-fc3d-4e8b-bfc6-22891b477289 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:10.488993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd156a2-fc3d-4e8b-bfc6-22891b477289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:10.536210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-abd156a2-fc3d-4e8b-bfc6-22891b477289 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:10.537371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-abd156a2-fc3d-4e8b-bfc6-22891b477289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:10.694767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:10.714824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e224-02d3-443b-97d9-7a042ec9d405 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:10.729322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 83/167] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:10.730184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd156a2-fc3d-4e8b-bfc6-22891b477289 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:10.794181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936331fd-850c-4893-8b6c-1cff703e58d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:10.794758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936331fd-850c-4893-8b6c-1cff703e58d4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:10.795036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936331fd-850c-4893-8b6c-1cff703e58d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:10.795303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936331fd-850c-4893-8b6c-1cff703e58d4 None admin] PATH_INFO: `/v3/users/c4cff41da8b84a87883a6878ed4555c6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:10.801503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936331fd-850c-4893-8b6c-1cff703e58d4 None admin] RBAC: Authorizing `identity:get_user(user_id=c4cff41da8b84a87883a6878ed4555c6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:10.802970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936331fd-850c-4893-8b6c-1cff703e58d4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:10.804624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 85/168] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:10 2022] GET /identity/v3/users/c4cff41da8b84a87883a6878ed4555c6 => generated 247 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:10.805427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936331fd-850c-4893-8b6c-1cff703e58d4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:10.938491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:10.952651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd156a2-fc3d-4e8b-bfc6-22891b477289 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:11.033659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936331fd-850c-4893-8b6c-1cff703e58d4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:11.062148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b73afb-8f74-4ee1-9cfb-c2acbe4aa1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:11.062696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b73afb-8f74-4ee1-9cfb-c2acbe4aa1eb None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.062969 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b73afb-8f74-4ee1-9cfb-c2acbe4aa1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.063241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b73afb-8f74-4ee1-9cfb-c2acbe4aa1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.092328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6260704-db99-40a2-8e93-68f7cd0b7f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:11.093509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6260704-db99-40a2-8e93-68f7cd0b7f60 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.094019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6260704-db99-40a2-8e93-68f7cd0b7f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.094513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6260704-db99-40a2-8e93-68f7cd0b7f60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.110729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6260704-db99-40a2-8e93-68f7cd0b7f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e6260704-db99-40a2-8e93-68f7cd0b7f60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:11.116138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:11.117052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:11.117838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:11.120243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 86/169] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:11.129038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6260704-db99-40a2-8e93-68f7cd0b7f60 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:11.238272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:11.258635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b73afb-8f74-4ee1-9cfb-c2acbe4aa1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:11.260432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b73afb-8f74-4ee1-9cfb-c2acbe4aa1eb None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:11.287955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6260704-db99-40a2-8e93-68f7cd0b7f60 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:11.305121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:11.344382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c8514-12b5-4a64-bfba-2c0ddfd10989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:11.345194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c8514-12b5-4a64-bfba-2c0ddfd10989 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.345663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c8514-12b5-4a64-bfba-2c0ddfd10989 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.345946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c8514-12b5-4a64-bfba-2c0ddfd10989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.413108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 84/170] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:11.414069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b73afb-8f74-4ee1-9cfb-c2acbe4aa1eb None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:11.462029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c8514-12b5-4a64-bfba-2c0ddfd10989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:11.463702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c8514-12b5-4a64-bfba-2c0ddfd10989 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:11.522032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:11.532072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b73afb-8f74-4ee1-9cfb-c2acbe4aa1eb None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:11.569688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b5171-a412-49c3-b482-6030addc13d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:11.570334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b5171-a412-49c3-b482-6030addc13d1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.570616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b5171-a412-49c3-b482-6030addc13d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.570892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b5171-a412-49c3-b482-6030addc13d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.571631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b5171-a412-49c3-b482-6030addc13d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:11.571937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b5171-a412-49c3-b482-6030addc13d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:11.573504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b5171-a412-49c3-b482-6030addc13d1 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:11.583543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 85/171] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:11.584921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c59d1c-590e-403a-b7e2-66a7eab020ee None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.585207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c59d1c-590e-403a-b7e2-66a7eab020ee None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.585479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c59d1c-590e-403a-b7e2-66a7eab020ee None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.586990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 86/172] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:11.587868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c59d1c-590e-403a-b7e2-66a7eab020ee None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:11.590298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 87/173] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:11.591563 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28084f-6a01-4337-a789-46e092d2687f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.591841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28084f-6a01-4337-a789-46e092d2687f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.592111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28084f-6a01-4337-a789-46e092d2687f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.593461 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 88/174] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:11.599069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28084f-6a01-4337-a789-46e092d2687f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:11.611380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:11.704335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28084f-6a01-4337-a789-46e092d2687f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:11.707033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c59d1c-590e-403a-b7e2-66a7eab020ee None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:11.739384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832b3f-b7e9-424b-9a91-9877422e7c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:11.740048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832b3f-b7e9-424b-9a91-9877422e7c1a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.740292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832b3f-b7e9-424b-9a91-9877422e7c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.740570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832b3f-b7e9-424b-9a91-9877422e7c1a None admin] PATH_INFO: `/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.741757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95832b3f-b7e9-424b-9a91-9877422e7c1a None admin] RBAC: Authorizing `identity:get_user(user_id=7ff0fdbd5cea443b8457e0eba48b93ac)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:11.743200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95832b3f-b7e9-424b-9a91-9877422e7c1a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:11.744821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 89/175] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:11 2022] GET /identity/v3/users/7ff0fdbd5cea443b8457e0eba48b93ac => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:11.749360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d75a-d337-4a49-90e7-7bc4b87f0dba None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.749360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d75a-d337-4a49-90e7-7bc4b87f0dba None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.749360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685d75a-d337-4a49-90e7-7bc4b87f0dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.750419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35b5f1-0d8a-45f0-9574-528d630617cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:11.751169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35b5f1-0d8a-45f0-9574-528d630617cc None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.751455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35b5f1-0d8a-45f0-9574-528d630617cc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.751743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35b5f1-0d8a-45f0-9574-528d630617cc None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.753479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35b5f1-0d8a-45f0-9574-528d630617cc None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:11.755999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35b5f1-0d8a-45f0-9574-528d630617cc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:11.762385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 87/176] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:11 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:11.762385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d5e49-bc7a-47e7-81b9-6cb41a85c34a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.762385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d5e49-bc7a-47e7-81b9-6cb41a85c34a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.762385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d5e49-bc7a-47e7-81b9-6cb41a85c34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.765247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6685d75a-d337-4a49-90e7-7bc4b87f0dba None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:11.766599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6685d75a-d337-4a49-90e7-7bc4b87f0dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:11.780261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-221d5e49-bc7a-47e7-81b9-6cb41a85c34a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:11.781458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-221d5e49-bc7a-47e7-81b9-6cb41a85c34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:11.797035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:11.837713 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 90/177] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:11.838976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d75a-d337-4a49-90e7-7bc4b87f0dba None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:11.847415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:11.872873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 88/178] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:11.872873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967294a-559c-4943-a0d8-18804234a2ec None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.872873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967294a-559c-4943-a0d8-18804234a2ec None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.872873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967294a-559c-4943-a0d8-18804234a2ec None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.872873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 89/179] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:11.875352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967294a-559c-4943-a0d8-18804234a2ec None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:11.956252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685d75a-d337-4a49-90e7-7bc4b87f0dba None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:11.988916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967294a-559c-4943-a0d8-18804234a2ec None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:11.991279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1c8cb-87fa-4736-9b96-6d5d3f89f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:11.992120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1c8cb-87fa-4736-9b96-6d5d3f89f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:11.992397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1c8cb-87fa-4736-9b96-6d5d3f89f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:11.992662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1c8cb-87fa-4736-9b96-6d5d3f89f9a5 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:11.993835 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1c8cb-87fa-4736-9b96-6d5d3f89f9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:11.995271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1c8cb-87fa-4736-9b96-6d5d3f89f9a5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:11.997106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 91/180] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:11 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:12.001780 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1c8cb-87fa-4736-9b96-6d5d3f89f9a5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.027426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6007e-c717-49be-af25-856cb2171354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.028185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6007e-c717-49be-af25-856cb2171354 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.028469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6007e-c717-49be-af25-856cb2171354 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.028866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6007e-c717-49be-af25-856cb2171354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.048841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.078393 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.101898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6007e-c717-49be-af25-856cb2171354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:12.103363 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6007e-c717-49be-af25-856cb2171354 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:12.108297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1c8cb-87fa-4736-9b96-6d5d3f89f9a5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.146580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53a6d4-23fa-4b67-bb15-32921a581e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.147221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53a6d4-23fa-4b67-bb15-32921a581e17 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.147497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53a6d4-23fa-4b67-bb15-32921a581e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.147782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53a6d4-23fa-4b67-bb15-32921a581e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.148555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53a6d4-23fa-4b67-bb15-32921a581e17 None admin] RBAC: Adding query filter params (role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=f98454c570304481a24ebb7a92189d26, user.id=7ff0fdbd5cea443b8457e0eba48b93ac) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:12.148892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53a6d4-23fa-4b67-bb15-32921a581e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:12.150605 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53a6d4-23fa-4b67-bb15-32921a581e17 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:12.171856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 92/181] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:11 2022] GET /identity/v3/role_assignments?user.id=7ff0fdbd5cea443b8457e0eba48b93ac&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:12.171856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53a6d4-23fa-4b67-bb15-32921a581e17 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.232150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 90/182] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:12.233866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf0e24-ff3b-4e22-993a-b60cb49f44ad None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.235130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf0e24-ff3b-4e22-993a-b60cb49f44ad None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.236082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf0e24-ff3b-4e22-993a-b60cb49f44ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.259712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9cdf0e24-ff3b-4e22-993a-b60cb49f44ad None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:12.261674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9cdf0e24-ff3b-4e22-993a-b60cb49f44ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:12.307440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53a6d4-23fa-4b67-bb15-32921a581e17 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.318081 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.339930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 91/183] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:12.341381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf0e24-ff3b-4e22-993a-b60cb49f44ad None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.360625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70572bd6-1a93-4659-aa0a-493d99d169b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.361355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70572bd6-1a93-4659-aa0a-493d99d169b5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.361637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70572bd6-1a93-4659-aa0a-493d99d169b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.361912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70572bd6-1a93-4659-aa0a-493d99d169b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.374039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.376364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70572bd6-1a93-4659-aa0a-493d99d169b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-70572bd6-1a93-4659-aa0a-493d99d169b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:12.382825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:12.388311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 93/184] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:47:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:12.389173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70572bd6-1a93-4659-aa0a-493d99d169b5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.476940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf0e24-ff3b-4e22-993a-b60cb49f44ad None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.507616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70572bd6-1a93-4659-aa0a-493d99d169b5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.510540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435e9c-d18c-4b87-8654-8478a5394e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.511176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435e9c-d18c-4b87-8654-8478a5394e7d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.511450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435e9c-d18c-4b87-8654-8478a5394e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.511715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435e9c-d18c-4b87-8654-8478a5394e7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.512864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73435e9c-d18c-4b87-8654-8478a5394e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:12.514354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73435e9c-d18c-4b87-8654-8478a5394e7d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:12.516131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 92/185] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:12.516769 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435e9c-d18c-4b87-8654-8478a5394e7d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.543663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6ded4-e34e-432c-9100-e622169478c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.544284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6ded4-e34e-432c-9100-e622169478c3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.544561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6ded4-e34e-432c-9100-e622169478c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.544862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6ded4-e34e-432c-9100-e622169478c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.545644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6ded4-e34e-432c-9100-e622169478c3 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=f98454c570304481a24ebb7a92189d26, user.id=c4cff41da8b84a87883a6878ed4555c6) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:12.545958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6ded4-e34e-432c-9100-e622169478c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:12.547403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6ded4-e34e-432c-9100-e622169478c3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:12.553888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 94/186] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:12 2022] GET /identity/v3/role_assignments?user.id=c4cff41da8b84a87883a6878ed4555c6&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:12.554454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6ded4-e34e-432c-9100-e622169478c3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.582315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.639080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435e9c-d18c-4b87-8654-8478a5394e7d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.665696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.677920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb29016-3727-46c8-a213-9524ab621fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.678621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb29016-3727-46c8-a213-9524ab621fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.678896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb29016-3727-46c8-a213-9524ab621fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.679165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb29016-3727-46c8-a213-9524ab621fd0 None admin] PATH_INFO: `/v3/projects/3edd8847b2504659b5cf25790ebf2fb2` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.680830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb29016-3727-46c8-a213-9524ab621fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=3edd8847b2504659b5cf25790ebf2fb2)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:12.682036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb29016-3727-46c8-a213-9524ab621fd0 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:12.689347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 93/187] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:12 2022] GET /identity/v3/projects/3edd8847b2504659b5cf25790ebf2fb2 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:12.689347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb29016-3727-46c8-a213-9524ab621fd0 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.722701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6ded4-e34e-432c-9100-e622169478c3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.760341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df2c9-dc0e-46f9-bac2-e704044604dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.760967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df2c9-dc0e-46f9-bac2-e704044604dd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.761193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df2c9-dc0e-46f9-bac2-e704044604dd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.761455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df2c9-dc0e-46f9-bac2-e704044604dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.773868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931df2c9-dc0e-46f9-bac2-e704044604dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-931df2c9-dc0e-46f9-bac2-e704044604dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:12.780119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:12.781020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 95/188] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:12.789530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5209-8a76-485f-a4a0-ac73f52f76f1 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.790237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5209-8a76-485f-a4a0-ac73f52f76f1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.790237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5209-8a76-485f-a4a0-ac73f52f76f1 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.790237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 96/189] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:12.790237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c5209-8a76-485f-a4a0-ac73f52f76f1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.798554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb29016-3727-46c8-a213-9524ab621fd0 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.816170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.834395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ce10e-2609-4c3b-b47c-3c6969e457a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.835002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ce10e-2609-4c3b-b47c-3c6969e457a9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.838135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ce10e-2609-4c3b-b47c-3c6969e457a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.838135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ce10e-2609-4c3b-b47c-3c6969e457a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.838135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ce10e-2609-4c3b-b47c-3c6969e457a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:12.838135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ce10e-2609-4c3b-b47c-3c6969e457a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:12.838135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ce10e-2609-4c3b-b47c-3c6969e457a9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:12.846454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 94/190] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:12.851363 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ce10e-2609-4c3b-b47c-3c6969e457a9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:12.886094 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c5209-8a76-485f-a4a0-ac73f52f76f1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.907736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:12.928930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9244a-5d03-4ee0-8c47-007b41fb0fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.929558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9244a-5d03-4ee0-8c47-007b41fb0fa4 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.929838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9244a-5d03-4ee0-8c47-007b41fb0fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.930107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9244a-5d03-4ee0-8c47-007b41fb0fa4 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.930784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9244a-5d03-4ee0-8c47-007b41fb0fa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:12.932237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9244a-5d03-4ee0-8c47-007b41fb0fa4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:12.947937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ce10e-2609-4c3b-b47c-3c6969e457a9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:12.983045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85f366-6095-448f-a7e8-9c934c28fd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:12.983656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f366-6095-448f-a7e8-9c934c28fd97 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:12.983936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f366-6095-448f-a7e8-9c934c28fd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:12.984204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f366-6095-448f-a7e8-9c934c28fd97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:12.985013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85f366-6095-448f-a7e8-9c934c28fd97 None admin] RBAC: Adding query filter params (role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=3edd8847b2504659b5cf25790ebf2fb2, user.id=7ff0fdbd5cea443b8457e0eba48b93ac) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:12.985318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85f366-6095-448f-a7e8-9c934c28fd97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:12.986816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85f366-6095-448f-a7e8-9c934c28fd97 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:12.992443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 95/191] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:12 2022] GET /identity/v3/role_assignments?user.id=7ff0fdbd5cea443b8457e0eba48b93ac&scope.project.id=3edd8847b2504659b5cf25790ebf2fb2&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:12.993239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85f366-6095-448f-a7e8-9c934c28fd97 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:13.039809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:13.049010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 97/192] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:12 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:13.051101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add42a2d-0329-45cb-9b6c-a54f4891e853 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:13.053399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add42a2d-0329-45cb-9b6c-a54f4891e853 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:13.053399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add42a2d-0329-45cb-9b6c-a54f4891e853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:13.090356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-add42a2d-0329-45cb-9b6c-a54f4891e853 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:13.092099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-add42a2d-0329-45cb-9b6c-a54f4891e853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:13.111185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85f366-6095-448f-a7e8-9c934c28fd97 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:13.155252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a36e9-bfe6-4be6-9dce-8afe5a68f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:13.156243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a36e9-bfe6-4be6-9dce-8afe5a68f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:13.156673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a36e9-bfe6-4be6-9dce-8afe5a68f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:13.157143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a36e9-bfe6-4be6-9dce-8afe5a68f7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:13.158858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a36e9-bfe6-4be6-9dce-8afe5a68f7a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:13.159174 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a36e9-bfe6-4be6-9dce-8afe5a68f7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:13.160596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a36e9-bfe6-4be6-9dce-8afe5a68f7a8 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:13.181279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 96/193] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:13.182482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a36e9-bfe6-4be6-9dce-8afe5a68f7a8 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:13.197883 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 98/194] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:13.198788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add42a2d-0329-45cb-9b6c-a54f4891e853 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:13.311890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a36e9-bfe6-4be6-9dce-8afe5a68f7a8 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:13.314205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:13.337062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add42a2d-0329-45cb-9b6c-a54f4891e853 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:13.348445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:13.356739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1bb4d-24bd-46ce-8f03-6db89c447317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:13.358149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1bb4d-24bd-46ce-8f03-6db89c447317 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:13.358448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1bb4d-24bd-46ce-8f03-6db89c447317 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:13.358728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1bb4d-24bd-46ce-8f03-6db89c447317 None admin] PATH_INFO: `/v3/users/3edade336a344919962137e411fb188d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:13.378012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1bb4d-24bd-46ce-8f03-6db89c447317 None admin] RBAC: Authorizing `identity:get_user(user_id=3edade336a344919962137e411fb188d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:13.379496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1bb4d-24bd-46ce-8f03-6db89c447317 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:13.381335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 97/195] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:13 2022] GET /identity/v3/users/3edade336a344919962137e411fb188d => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:13.383604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1bb4d-24bd-46ce-8f03-6db89c447317 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:13.394191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd21f17-34f1-4ce9-9f0c-0e579d846bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:13.394855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd21f17-34f1-4ce9-9f0c-0e579d846bee None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:13.395223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd21f17-34f1-4ce9-9f0c-0e579d846bee None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:13.395415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd21f17-34f1-4ce9-9f0c-0e579d846bee None admin] PATH_INFO: `/v3/users/3edade336a344919962137e411fb188d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:13.397737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd21f17-34f1-4ce9-9f0c-0e579d846bee None admin] RBAC: Authorizing `identity:get_user(user_id=3edade336a344919962137e411fb188d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:13.399223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd21f17-34f1-4ce9-9f0c-0e579d846bee None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:13.400854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 99/196] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:13 2022] GET /identity/v3/users/3edade336a344919962137e411fb188d => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:13.401543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd21f17-34f1-4ce9-9f0c-0e579d846bee None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:13.515441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd21f17-34f1-4ce9-9f0c-0e579d846bee None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:13.534563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1bb4d-24bd-46ce-8f03-6db89c447317 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:13.567373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98112-78ab-4f67-bcf9-4aba90087d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:13.568598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98112-78ab-4f67-bcf9-4aba90087d39 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:13.569150 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98112-78ab-4f67-bcf9-4aba90087d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:13.569584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98112-78ab-4f67-bcf9-4aba90087d39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:13.573277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86934c1b-9d87-4113-8011-00529c3a1b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:13.573929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86934c1b-9d87-4113-8011-00529c3a1b83 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:13.575049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86934c1b-9d87-4113-8011-00529c3a1b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:13.575049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86934c1b-9d87-4113-8011-00529c3a1b83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:13.586619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86934c1b-9d87-4113-8011-00529c3a1b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-86934c1b-9d87-4113-8011-00529c3a1b83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:13.591958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:13.593089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:13.594070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:13.595898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 98/197] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:13.596924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86934c1b-9d87-4113-8011-00529c3a1b83 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:13.624406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:13.634767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:13.659491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b98112-78ab-4f67-bcf9-4aba90087d39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:13.661007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b98112-78ab-4f67-bcf9-4aba90087d39 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:13.733720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86934c1b-9d87-4113-8011-00529c3a1b83 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:13.778659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c3306-fc05-4af9-877c-d963612fd2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:13.779238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3306-fc05-4af9-877c-d963612fd2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:13.779524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3306-fc05-4af9-877c-d963612fd2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:13.779798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3306-fc05-4af9-877c-d963612fd2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:13.787023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 100/198] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:13.788505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98112-78ab-4f67-bcf9-4aba90087d39 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:13.870568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:13.877627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c3306-fc05-4af9-877c-d963612fd2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:13.879792 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c3306-fc05-4af9-877c-d963612fd2d6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:13.897731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98112-78ab-4f67-bcf9-4aba90087d39 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:13.906849 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:13.950177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539a70-9a1c-4ca8-83e8-31bc6322b597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:13.951494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539a70-9a1c-4ca8-83e8-31bc6322b597 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:13.951974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539a70-9a1c-4ca8-83e8-31bc6322b597 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:13.953053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38539a70-9a1c-4ca8-83e8-31bc6322b597 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:13.954326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38539a70-9a1c-4ca8-83e8-31bc6322b597 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:13.954830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38539a70-9a1c-4ca8-83e8-31bc6322b597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:13.957628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38539a70-9a1c-4ca8-83e8-31bc6322b597 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:13.969546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 101/199] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:13.971133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539a70-9a1c-4ca8-83e8-31bc6322b597 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:14.000022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 99/200] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:14.001635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c3306-fc05-4af9-877c-d963612fd2d6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:14.081612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38539a70-9a1c-4ca8-83e8-31bc6322b597 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:14.117757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406cb48-065d-4523-878b-854695f566ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:14.118405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406cb48-065d-4523-878b-854695f566ae None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:14.118682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406cb48-065d-4523-878b-854695f566ae None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:14.118957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406cb48-065d-4523-878b-854695f566ae None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:14.120113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406cb48-065d-4523-878b-854695f566ae None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:14.121778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406cb48-065d-4523-878b-854695f566ae None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:14.123757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 102/201] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:13 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:14.124637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406cb48-065d-4523-878b-854695f566ae None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:14.135124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c3306-fc05-4af9-877c-d963612fd2d6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:14.135816 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:14.160254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:14.178507 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026393b-b585-4eeb-8dc8-67e057916248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:14.179842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026393b-b585-4eeb-8dc8-67e057916248 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:14.180132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026393b-b585-4eeb-8dc8-67e057916248 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:14.180465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026393b-b585-4eeb-8dc8-67e057916248 None admin] PATH_INFO: `/v3/users/83768e0e54a2455eb3b7b60ea6aecf34` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:14.181704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026393b-b585-4eeb-8dc8-67e057916248 None admin] RBAC: Authorizing `identity:get_user(user_id=83768e0e54a2455eb3b7b60ea6aecf34)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:14.183171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026393b-b585-4eeb-8dc8-67e057916248 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:14.185465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 100/202] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:14 2022] GET /identity/v3/users/83768e0e54a2455eb3b7b60ea6aecf34 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:14.186351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026393b-b585-4eeb-8dc8-67e057916248 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:14.259765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406cb48-065d-4523-878b-854695f566ae None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:14.298081 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026393b-b585-4eeb-8dc8-67e057916248 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:14.308130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54654171-78ca-47a9-a713-0ea83b12c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:14.309569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654171-78ca-47a9-a713-0ea83b12c548 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:14.310344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654171-78ca-47a9-a713-0ea83b12c548 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:14.311221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654171-78ca-47a9-a713-0ea83b12c548 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:14.313086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54654171-78ca-47a9-a713-0ea83b12c548 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:14.316003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54654171-78ca-47a9-a713-0ea83b12c548 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:14.319055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 103/203] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:14 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:14.320208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54654171-78ca-47a9-a713-0ea83b12c548 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:14.343337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c6bf7-96cd-475c-8b20-e9f326d58565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:14.343965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c6bf7-96cd-475c-8b20-e9f326d58565 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:14.344351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c6bf7-96cd-475c-8b20-e9f326d58565 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:14.344633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c6bf7-96cd-475c-8b20-e9f326d58565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:14.345543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c6bf7-96cd-475c-8b20-e9f326d58565 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72, user.id=3edade336a344919962137e411fb188d) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:14.345885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c6bf7-96cd-475c-8b20-e9f326d58565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:14.347387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c6bf7-96cd-475c-8b20-e9f326d58565 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:14.353850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 101/204] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:14 2022] GET /identity/v3/role_assignments?user.id=3edade336a344919962137e411fb188d&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:14.354903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c6bf7-96cd-475c-8b20-e9f326d58565 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:14.413706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:14.418325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:14.443058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54654171-78ca-47a9-a713-0ea83b12c548 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:14.468860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c6bf7-96cd-475c-8b20-e9f326d58565 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:14.482654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72ea99-fdb9-48d3-9f56-312a4caed98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:14.483682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72ea99-fdb9-48d3-9f56-312a4caed98c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:14.484162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72ea99-fdb9-48d3-9f56-312a4caed98c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:14.484633 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72ea99-fdb9-48d3-9f56-312a4caed98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:14.508658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e91051-edf5-45dc-9227-06ded0aedb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:14.509329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e91051-edf5-45dc-9227-06ded0aedb95 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:14.509611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e91051-edf5-45dc-9227-06ded0aedb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:14.509885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e91051-edf5-45dc-9227-06ded0aedb95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:14.510687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e91051-edf5-45dc-9227-06ded0aedb95 None admin] RBAC: Adding query filter params (role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72, user.id=3edade336a344919962137e411fb188d) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:14.511058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e91051-edf5-45dc-9227-06ded0aedb95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:14.512577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e91051-edf5-45dc-9227-06ded0aedb95 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:14.525045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 102/205] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:14 2022] GET /identity/v3/role_assignments?user.id=3edade336a344919962137e411fb188d&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:14.572642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72ea99-fdb9-48d3-9f56-312a4caed98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:14.575472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72ea99-fdb9-48d3-9f56-312a4caed98c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:14.664826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:14.694794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 104/206] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:14.700594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e91051-edf5-45dc-9227-06ded0aedb95 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:14.811734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e91051-edf5-45dc-9227-06ded0aedb95 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:14.830114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:14.847900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fb1f9-c3db-4d67-bd5f-95e07387060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:14.848950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fb1f9-c3db-4d67-bd5f-95e07387060a None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:14.849452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fb1f9-c3db-4d67-bd5f-95e07387060a None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:14.849921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fb1f9-c3db-4d67-bd5f-95e07387060a None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:14.851287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fb1f9-c3db-4d67-bd5f-95e07387060a None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:14.852973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fb1f9-c3db-4d67-bd5f-95e07387060a None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:14.855190 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 103/207] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:14 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:14.865960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72ea99-fdb9-48d3-9f56-312a4caed98c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:15.007667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72ea99-fdb9-48d3-9f56-312a4caed98c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:15.044842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9131a6d-4194-4400-9f8c-b845d3d0fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:15.045822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9131a6d-4194-4400-9f8c-b845d3d0fc99 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.046335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9131a6d-4194-4400-9f8c-b845d3d0fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.046888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9131a6d-4194-4400-9f8c-b845d3d0fc99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.047874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9131a6d-4194-4400-9f8c-b845d3d0fc99 None admin] RBAC: Adding query filter params (role.id=cfeca18af06d4545b5672877734062d7, scope.project.id=f98454c570304481a24ebb7a92189d26, user.id=83768e0e54a2455eb3b7b60ea6aecf34) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:15.048380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9131a6d-4194-4400-9f8c-b845d3d0fc99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:15.050069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9131a6d-4194-4400-9f8c-b845d3d0fc99 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:15.056301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 105/208] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:14 2022] GET /identity/v3/role_assignments?user.id=83768e0e54a2455eb3b7b60ea6aecf34&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=cfeca18af06d4545b5672877734062d7 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:15.260483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da182f1-1a7b-4b18-90db-6ed0ce612b02 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.261432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da182f1-1a7b-4b18-90db-6ed0ce612b02 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.261905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da182f1-1a7b-4b18-90db-6ed0ce612b02 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.263479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 104/209] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:15.268996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a29451-11d2-427e-aab5-ab8cb7a11fba None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.269286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a29451-11d2-427e-aab5-ab8cb7a11fba None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.269559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a29451-11d2-427e-aab5-ab8cb7a11fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.288488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-05a29451-11d2-427e-aab5-ab8cb7a11fba None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:15.289770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-05a29451-11d2-427e-aab5-ab8cb7a11fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:15.336595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:15.389452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 106/210] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:15.414664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da182f1-1a7b-4b18-90db-6ed0ce612b02 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:15.545166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da182f1-1a7b-4b18-90db-6ed0ce612b02 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:15.581189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18249ec5-8c41-4d2e-8276-a05e2aa7032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:15.585825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18249ec5-8c41-4d2e-8276-a05e2aa7032c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.585825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18249ec5-8c41-4d2e-8276-a05e2aa7032c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.585825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18249ec5-8c41-4d2e-8276-a05e2aa7032c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.593227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18249ec5-8c41-4d2e-8276-a05e2aa7032c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-18249ec5-8c41-4d2e-8276-a05e2aa7032c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:15.599494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:15.600371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:15.601195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 105/211] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:15.606647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892268b-7f2c-4c5b-a033-785b2b1cc447 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.606933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892268b-7f2c-4c5b-a033-785b2b1cc447 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.607034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18249ec5-8c41-4d2e-8276-a05e2aa7032c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:15.607207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892268b-7f2c-4c5b-a033-785b2b1cc447 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.608554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 107/212] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:15.613592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a92efe-0f74-4213-8256-ce739e87a06b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.613878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a92efe-0f74-4213-8256-ce739e87a06b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.614156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a92efe-0f74-4213-8256-ce739e87a06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.632307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-64a92efe-0f74-4213-8256-ce739e87a06b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:15.633526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-64a92efe-0f74-4213-8256-ce739e87a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:15.690659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:15.720391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 108/213] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:15.738818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a92efe-0f74-4213-8256-ce739e87a06b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:15.749848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18249ec5-8c41-4d2e-8276-a05e2aa7032c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:15.785757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9207e42-0500-46af-8329-10dcbc7260ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:15.786385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9207e42-0500-46af-8329-10dcbc7260ff None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.786670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9207e42-0500-46af-8329-10dcbc7260ff None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.786948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9207e42-0500-46af-8329-10dcbc7260ff None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.787665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9207e42-0500-46af-8329-10dcbc7260ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:15.787970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9207e42-0500-46af-8329-10dcbc7260ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:15.789388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9207e42-0500-46af-8329-10dcbc7260ff None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:15.797815 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 106/214] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:15.803661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9207e42-0500-46af-8329-10dcbc7260ff None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:15.844500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:15.848963 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a92efe-0f74-4213-8256-ce739e87a06b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:15.887695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04553-7608-477e-85e8-40349ed4f226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:15.888464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04553-7608-477e-85e8-40349ed4f226 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.888702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04553-7608-477e-85e8-40349ed4f226 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.889101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04553-7608-477e-85e8-40349ed4f226 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.890304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f04553-7608-477e-85e8-40349ed4f226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:15.891973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f04553-7608-477e-85e8-40349ed4f226 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:15.899934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 109/215] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:15.900761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04553-7608-477e-85e8-40349ed4f226 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:15.908339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9207e42-0500-46af-8329-10dcbc7260ff None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:15.917515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:15.943358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dce38-46bb-4457-bb36-4c90e2a75fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:15.944102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dce38-46bb-4457-bb36-4c90e2a75fcc None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:15.944455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dce38-46bb-4457-bb36-4c90e2a75fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:15.944817 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dce38-46bb-4457-bb36-4c90e2a75fcc None admin] PATH_INFO: `/v3/users/f2a1ea2245a1465e8421a80bf1eac998` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:15.959944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dce38-46bb-4457-bb36-4c90e2a75fcc None admin] RBAC: Authorizing `identity:get_user(user_id=f2a1ea2245a1465e8421a80bf1eac998)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:15.961579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dce38-46bb-4457-bb36-4c90e2a75fcc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:15.963767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 107/216] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:15 2022] GET /identity/v3/users/f2a1ea2245a1465e8421a80bf1eac998 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:15.969421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dce38-46bb-4457-bb36-4c90e2a75fcc None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:16.011233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04553-7608-477e-85e8-40349ed4f226 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:16.057224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c199fb1-0957-45d6-862e-5a9d0821d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:16.057791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c199fb1-0957-45d6-862e-5a9d0821d630 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:16.058134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c199fb1-0957-45d6-862e-5a9d0821d630 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:16.058408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c199fb1-0957-45d6-862e-5a9d0821d630 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:16.059087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c199fb1-0957-45d6-862e-5a9d0821d630 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:16.060912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c199fb1-0957-45d6-862e-5a9d0821d630 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:16.081422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dce38-46bb-4457-bb36-4c90e2a75fcc None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:16.121426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fbf88-2ff2-434b-b8e5-b76d6ce0e138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:16.122829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fbf88-2ff2-434b-b8e5-b76d6ce0e138 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:16.122829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fbf88-2ff2-434b-b8e5-b76d6ce0e138 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:16.122829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fbf88-2ff2-434b-b8e5-b76d6ce0e138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:16.156813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:16.186029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 110/217] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:15 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:16.207263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fbf88-2ff2-434b-b8e5-b76d6ce0e138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:16.210370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fbf88-2ff2-434b-b8e5-b76d6ce0e138 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:16.330644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 108/218] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:16.336449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c199fb1-0957-45d6-862e-5a9d0821d630 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:16.366930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:16.446233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c199fb1-0957-45d6-862e-5a9d0821d630 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:16.484283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01528a79-c9b5-4f12-a4cf-a36d360365c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:16.484980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01528a79-c9b5-4f12-a4cf-a36d360365c7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:16.485257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01528a79-c9b5-4f12-a4cf-a36d360365c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:16.485528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01528a79-c9b5-4f12-a4cf-a36d360365c7 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:16.488312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01528a79-c9b5-4f12-a4cf-a36d360365c7 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:16.489792 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01528a79-c9b5-4f12-a4cf-a36d360365c7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:16.491655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 111/219] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:16 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:16.497372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fbf88-2ff2-434b-b8e5-b76d6ce0e138 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:16.585422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:16.628018 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fbf88-2ff2-434b-b8e5-b76d6ce0e138 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:16.675183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df4a42-5e5f-490d-827a-7e31f2534799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:16.676160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df4a42-5e5f-490d-827a-7e31f2534799 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:16.676669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df4a42-5e5f-490d-827a-7e31f2534799 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:16.677160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df4a42-5e5f-490d-827a-7e31f2534799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:16.678145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df4a42-5e5f-490d-827a-7e31f2534799 None admin] RBAC: Adding query filter params (role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72, user.id=f2a1ea2245a1465e8421a80bf1eac998) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:16.678674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df4a42-5e5f-490d-827a-7e31f2534799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:16.680324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df4a42-5e5f-490d-827a-7e31f2534799 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:16.686673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 109/220] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:16 2022] GET /identity/v3/role_assignments?user.id=f2a1ea2245a1465e8421a80bf1eac998&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:16.792443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e584e-6023-4927-95e4-b7fe4a82ee4a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:16.792765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e584e-6023-4927-95e4-b7fe4a82ee4a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:16.793014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e584e-6023-4927-95e4-b7fe4a82ee4a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:16.794391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 112/221] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:16.800424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8ed63-0526-4351-b96e-c58e948cc871 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:16.801069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8ed63-0526-4351-b96e-c58e948cc871 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:16.801558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8ed63-0526-4351-b96e-c58e948cc871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:16.825301 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-0bd8ed63-0526-4351-b96e-c58e948cc871 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:16.826918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0bd8ed63-0526-4351-b96e-c58e948cc871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:16.921497 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 110/222] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:16.945016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e584e-6023-4927-95e4-b7fe4a82ee4a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:17.023638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0229ca-a237-4501-aa10-ae62d4bad039 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.024575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0229ca-a237-4501-aa10-ae62d4bad039 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.025088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0229ca-a237-4501-aa10-ae62d4bad039 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.026974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 111/223] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:17.032666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541a3be-b6ef-4aa9-98cc-a1c27d42f73a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.034259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541a3be-b6ef-4aa9-98cc-a1c27d42f73a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.034757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541a3be-b6ef-4aa9-98cc-a1c27d42f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.056587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f541a3be-b6ef-4aa9-98cc-a1c27d42f73a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:17.058193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f541a3be-b6ef-4aa9-98cc-a1c27d42f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:17.121719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:17.127708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:17.134699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 112/224] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:17.150635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e584e-6023-4927-95e4-b7fe4a82ee4a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:17.164488 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541a3be-b6ef-4aa9-98cc-a1c27d42f73a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:17.206181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77ac3-2a56-4864-9e6a-1f08b9bf81f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:17.207162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77ac3-2a56-4864-9e6a-1f08b9bf81f3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.207619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77ac3-2a56-4864-9e6a-1f08b9bf81f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.208066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77ac3-2a56-4864-9e6a-1f08b9bf81f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.220248 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77ac3-2a56-4864-9e6a-1f08b9bf81f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1ac77ac3-2a56-4864-9e6a-1f08b9bf81f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:17.226368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:17.227253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:17.228071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:17.230615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 113/225] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:17.236766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77ac3-2a56-4864-9e6a-1f08b9bf81f3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:17.347815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77ac3-2a56-4864-9e6a-1f08b9bf81f3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:17.363322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541a3be-b6ef-4aa9-98cc-a1c27d42f73a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:17.384887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b83f58-462f-4958-ba5c-e095efa887f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:17.385751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b83f58-462f-4958-ba5c-e095efa887f1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.386200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b83f58-462f-4958-ba5c-e095efa887f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.386621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b83f58-462f-4958-ba5c-e095efa887f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.387488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b83f58-462f-4958-ba5c-e095efa887f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:17.387947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b83f58-462f-4958-ba5c-e095efa887f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:17.389493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b83f58-462f-4958-ba5c-e095efa887f1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:17.398848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 114/226] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:17.410097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b83f58-462f-4958-ba5c-e095efa887f1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:17.424736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34931a-b1fb-4aeb-86df-de22f0a501b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:17.425361 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34931a-b1fb-4aeb-86df-de22f0a501b3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.425639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34931a-b1fb-4aeb-86df-de22f0a501b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.425909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34931a-b1fb-4aeb-86df-de22f0a501b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.441530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:17.441771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34931a-b1fb-4aeb-86df-de22f0a501b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-1c34931a-b1fb-4aeb-86df-de22f0a501b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:17.446753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:17.447654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:17.448443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 113/227] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:47:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:17.456852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34931a-b1fb-4aeb-86df-de22f0a501b3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:17.554190 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:17.558788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b83f58-462f-4958-ba5c-e095efa887f1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:17.598375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110a3c0-572d-4d44-b6be-5b3933c22999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:17.599030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110a3c0-572d-4d44-b6be-5b3933c22999 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.599308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110a3c0-572d-4d44-b6be-5b3933c22999 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.599582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110a3c0-572d-4d44-b6be-5b3933c22999 None admin] PATH_INFO: `/v3/users/3edade336a344919962137e411fb188d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.600794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110a3c0-572d-4d44-b6be-5b3933c22999 None admin] RBAC: Authorizing `identity:get_user(user_id=3edade336a344919962137e411fb188d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:17.604027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110a3c0-572d-4d44-b6be-5b3933c22999 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:17.606225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 115/228] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:17 2022] GET /identity/v3/users/3edade336a344919962137e411fb188d => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:17.612581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110a3c0-572d-4d44-b6be-5b3933c22999 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:17.664631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34931a-b1fb-4aeb-86df-de22f0a501b3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:17.711546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:17.732155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faab903-6d02-42f5-802d-d138c36c25b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:17.732808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faab903-6d02-42f5-802d-d138c36c25b3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.733087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faab903-6d02-42f5-802d-d138c36c25b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.733359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faab903-6d02-42f5-802d-d138c36c25b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.734901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faab903-6d02-42f5-802d-d138c36c25b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:17.735210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faab903-6d02-42f5-802d-d138c36c25b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:17.737148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faab903-6d02-42f5-802d-d138c36c25b3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:17.748496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110a3c0-572d-4d44-b6be-5b3933c22999 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:17.755882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 114/229] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:17.762282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faab903-6d02-42f5-802d-d138c36c25b3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:17.812074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430143d0-3120-49c4-94c7-e391cbe576f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:17.813109 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430143d0-3120-49c4-94c7-e391cbe576f5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.813595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430143d0-3120-49c4-94c7-e391cbe576f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.814093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430143d0-3120-49c4-94c7-e391cbe576f5 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.815978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430143d0-3120-49c4-94c7-e391cbe576f5 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:17.817659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430143d0-3120-49c4-94c7-e391cbe576f5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:17.819864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 116/230] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:17 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:17.825750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430143d0-3120-49c4-94c7-e391cbe576f5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:17.947371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430143d0-3120-49c4-94c7-e391cbe576f5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:17.987779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3aa7-61dd-4638-be5e-11a2e16762e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:17.988825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3aa7-61dd-4638-be5e-11a2e16762e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:17.989310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3aa7-61dd-4638-be5e-11a2e16762e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:17.990048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3aa7-61dd-4638-be5e-11a2e16762e1 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/users/3edade336a344919962137e411fb188d/roles/5f8cf1f7cff749478558197b9f9ba38d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:17.993278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a3aa7-61dd-4638-be5e-11a2e16762e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e8d56fbcdf45a684d233aebc7e8b72, user_id=3edade336a344919962137e411fb188d, role_id=5f8cf1f7cff749478558197b9f9ba38d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:17.995228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a3aa7-61dd-4638-be5e-11a2e16762e1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:18.004990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faab903-6d02-42f5-802d-d138c36c25b3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:18.018773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:18.041212 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580063f9-c24f-4869-8691-39cc5c39477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:18.042123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580063f9-c24f-4869-8691-39cc5c39477f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:18.042547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580063f9-c24f-4869-8691-39cc5c39477f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:18.042977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580063f9-c24f-4869-8691-39cc5c39477f None admin] PATH_INFO: `/v3/users/3edade336a344919962137e411fb188d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:18.044496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580063f9-c24f-4869-8691-39cc5c39477f None admin] RBAC: Authorizing `identity:get_user(user_id=3edade336a344919962137e411fb188d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:18.046188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580063f9-c24f-4869-8691-39cc5c39477f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:18.047999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 115/231] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:17 2022] GET /identity/v3/users/3edade336a344919962137e411fb188d => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:18.054318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580063f9-c24f-4869-8691-39cc5c39477f None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:18.081859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 117/232] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:47:17 2022] PUT /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/users/3edade336a344919962137e411fb188d/roles/5f8cf1f7cff749478558197b9f9ba38d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:47:18.212263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580063f9-c24f-4869-8691-39cc5c39477f None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:18.250612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aadd1-efc7-4efc-aab7-eacab3a94ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:18.251231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aadd1-efc7-4efc-aab7-eacab3a94ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:18.251518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aadd1-efc7-4efc-aab7-eacab3a94ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:18.251864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aadd1-efc7-4efc-aab7-eacab3a94ad3 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:18.253129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aadd1-efc7-4efc-aab7-eacab3a94ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:18.254590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aadd1-efc7-4efc-aab7-eacab3a94ad3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:18.256350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 116/233] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:18 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:18.262100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3aa7-61dd-4638-be5e-11a2e16762e1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:18.274122 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:18.380442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3aa7-61dd-4638-be5e-11a2e16762e1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:18.415427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353284c-b0d1-4327-9c72-fe13911a32ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:18.416447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353284c-b0d1-4327-9c72-fe13911a32ff None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:18.416979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353284c-b0d1-4327-9c72-fe13911a32ff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:18.417447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353284c-b0d1-4327-9c72-fe13911a32ff None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/users/3edade336a344919962137e411fb188d/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:18.419613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353284c-b0d1-4327-9c72-fe13911a32ff None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e8d56fbcdf45a684d233aebc7e8b72, user_id=3edade336a344919962137e411fb188d, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:18.421313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353284c-b0d1-4327-9c72-fe13911a32ff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:18.523899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 118/234] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:47:18 2022] PUT /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/users/3edade336a344919962137e411fb188d/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:18.750301 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f5f67-7d5a-4db9-a0a8-09a19df3d5fa None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:18.750830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f5f67-7d5a-4db9-a0a8-09a19df3d5fa None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:18.750830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f5f67-7d5a-4db9-a0a8-09a19df3d5fa None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:18.752632 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 117/235] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:18.757708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad73a2-22ff-47a9-9ebc-3134680c974d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:18.758273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad73a2-22ff-47a9-9ebc-3134680c974d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:18.758748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad73a2-22ff-47a9-9ebc-3134680c974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:18.781673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c8ad73a2-22ff-47a9-9ebc-3134680c974d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:18.783238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c8ad73a2-22ff-47a9-9ebc-3134680c974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:18.859400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:18.865780 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 119/236] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:18.891408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00fa83-d4d2-48aa-a1a2-30014ce78196 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:18.891713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00fa83-d4d2-48aa-a1a2-30014ce78196 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:18.891967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00fa83-d4d2-48aa-a1a2-30014ce78196 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:18.894007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 118/237] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:18.899437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da541f-d1fd-4c88-a583-0d11aec90553 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:18.899983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da541f-d1fd-4c88-a583-0d11aec90553 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:18.900456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da541f-d1fd-4c88-a583-0d11aec90553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:18.902495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00fa83-d4d2-48aa-a1a2-30014ce78196 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:18.925033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-71da541f-d1fd-4c88-a583-0d11aec90553 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:18.927191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-71da541f-d1fd-4c88-a583-0d11aec90553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:19.008468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:19.021100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 120/238] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:19.055077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da541f-d1fd-4c88-a583-0d11aec90553 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:19.130995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00fa83-d4d2-48aa-a1a2-30014ce78196 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:19.189600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da541f-d1fd-4c88-a583-0d11aec90553 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:19.195271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477950de-636d-4890-b69d-0a70a4121a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:19.196090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477950de-636d-4890-b69d-0a70a4121a4b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.196568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477950de-636d-4890-b69d-0a70a4121a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.197024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477950de-636d-4890-b69d-0a70a4121a4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.209476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477950de-636d-4890-b69d-0a70a4121a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-477950de-636d-4890-b69d-0a70a4121a4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:19.215529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:19.216612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:19.217560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:19.220042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 119/239] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:19.221821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:19.223305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0962e-b5d3-482d-ac9f-bae08ff2f269 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.223771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0962e-b5d3-482d-ac9f-bae08ff2f269 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.224276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0962e-b5d3-482d-ac9f-bae08ff2f269 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.226013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 120/240] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:19.230031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0962e-b5d3-482d-ac9f-bae08ff2f269 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:19.235769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc30be0-3f59-4b80-86c5-3f824884c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:19.237042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc30be0-3f59-4b80-86c5-3f824884c396 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.237327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc30be0-3f59-4b80-86c5-3f824884c396 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.237598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc30be0-3f59-4b80-86c5-3f824884c396 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.238788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc30be0-3f59-4b80-86c5-3f824884c396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:19.240240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc30be0-3f59-4b80-86c5-3f824884c396 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:19.242441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 121/241] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:19.243685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1de8c-916c-4182-af60-ec0efc057361 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.243964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1de8c-916c-4182-af60-ec0efc057361 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.244242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1de8c-916c-4182-af60-ec0efc057361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.267266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-55e1de8c-916c-4182-af60-ec0efc057361 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:19.268672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-55e1de8c-916c-4182-af60-ec0efc057361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:19.349886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0962e-b5d3-482d-ac9f-bae08ff2f269 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:19.356414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 122/242] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:19.360940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1de8c-916c-4182-af60-ec0efc057361 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:19.367321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:19.395667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314bf44-4503-4e55-85d7-69380e12b0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:19.396877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314bf44-4503-4e55-85d7-69380e12b0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.397456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314bf44-4503-4e55-85d7-69380e12b0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.397995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314bf44-4503-4e55-85d7-69380e12b0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.398910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314bf44-4503-4e55-85d7-69380e12b0a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:19.399501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314bf44-4503-4e55-85d7-69380e12b0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:19.401470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314bf44-4503-4e55-85d7-69380e12b0a9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:19.412465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 121/243] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:19.413695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314bf44-4503-4e55-85d7-69380e12b0a9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:19.484282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1de8c-916c-4182-af60-ec0efc057361 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:19.512834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:19.522542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6396e-059a-4dbf-83a4-46b2c2ad73ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:19.523152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6396e-059a-4dbf-83a4-46b2c2ad73ec None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.523433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6396e-059a-4dbf-83a4-46b2c2ad73ec None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.527240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6396e-059a-4dbf-83a4-46b2c2ad73ec None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.527240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6396e-059a-4dbf-83a4-46b2c2ad73ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:19.527240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6396e-059a-4dbf-83a4-46b2c2ad73ec None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:19.530266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314bf44-4503-4e55-85d7-69380e12b0a9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:19.567245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9b402-ef11-4fda-bffd-7c3d0cba18b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:19.568254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9b402-ef11-4fda-bffd-7c3d0cba18b6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.568736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9b402-ef11-4fda-bffd-7c3d0cba18b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.569243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9b402-ef11-4fda-bffd-7c3d0cba18b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.580285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9b402-ef11-4fda-bffd-7c3d0cba18b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-b6e9b402-ef11-4fda-bffd-7c3d0cba18b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:19.585664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:19.586540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:19.587419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:19.588014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 122/244] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:19.589707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9b402-ef11-4fda-bffd-7c3d0cba18b6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:19.623288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:19.637810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 123/245] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:19 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:19.639068 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6396e-059a-4dbf-83a4-46b2c2ad73ec None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:19.702528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9b402-ef11-4fda-bffd-7c3d0cba18b6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:19.740309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5056c6b-0534-4690-b5ae-d607d058c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:19.741014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5056c6b-0534-4690-b5ae-d607d058c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.742221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5056c6b-0534-4690-b5ae-d607d058c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.742596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5056c6b-0534-4690-b5ae-d607d058c4a6 None admin] PATH_INFO: `/v3/users/a8b0765987cc473c9ea726d63fd9a91c` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.759974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5056c6b-0534-4690-b5ae-d607d058c4a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a8b0765987cc473c9ea726d63fd9a91c)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:19.761474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5056c6b-0534-4690-b5ae-d607d058c4a6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:19.763686 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 123/246] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:19 2022] GET /identity/v3/users/a8b0765987cc473c9ea726d63fd9a91c => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:19.766582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6396e-059a-4dbf-83a4-46b2c2ad73ec None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:19.769191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5056c6b-0534-4690-b5ae-d607d058c4a6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:19.807290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3eda6a-9795-47cd-ae71-3bfc5005ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:19.808318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3eda6a-9795-47cd-ae71-3bfc5005ddfa None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.808818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3eda6a-9795-47cd-ae71-3bfc5005ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.809289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3eda6a-9795-47cd-ae71-3bfc5005ddfa None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.810512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3eda6a-9795-47cd-ae71-3bfc5005ddfa None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:19.811041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3eda6a-9795-47cd-ae71-3bfc5005ddfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:19.812728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3eda6a-9795-47cd-ae71-3bfc5005ddfa None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:19.823659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 124/247] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:19.830413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3eda6a-9795-47cd-ae71-3bfc5005ddfa None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:19.864049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:19.894850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5056c6b-0534-4690-b5ae-d607d058c4a6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:19.895046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:19.916240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaf45d-9c22-4b87-8044-effea85709fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:19.916891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaf45d-9c22-4b87-8044-effea85709fc None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.917175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaf45d-9c22-4b87-8044-effea85709fc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.917451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaf45d-9c22-4b87-8044-effea85709fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.953394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3eda6a-9795-47cd-ae71-3bfc5005ddfa None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:19.991480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec29874-0f15-4f77-b3a8-841b32c94af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:19.992095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaf45d-9c22-4b87-8044-effea85709fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:19.992738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29874-0f15-4f77-b3a8-841b32c94af4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:19.993309 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29874-0f15-4f77-b3a8-841b32c94af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:19.993604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaf45d-9c22-4b87-8044-effea85709fc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:19.993993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29874-0f15-4f77-b3a8-841b32c94af4 None admin] PATH_INFO: `/v3/users/f2a1ea2245a1465e8421a80bf1eac998` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:19.995483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29874-0f15-4f77-b3a8-841b32c94af4 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a1ea2245a1465e8421a80bf1eac998)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:19.997252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29874-0f15-4f77-b3a8-841b32c94af4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:19.999452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 125/248] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:19 2022] GET /identity/v3/users/f2a1ea2245a1465e8421a80bf1eac998 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:20.005759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec29874-0f15-4f77-b3a8-841b32c94af4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:20.087214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:20.102139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 124/249] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:20.107663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaf45d-9c22-4b87-8044-effea85709fc None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:20.118759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec29874-0f15-4f77-b3a8-841b32c94af4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:20.134239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:20.158456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc00686-bff2-4210-ab26-3239e837bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:20.159442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc00686-bff2-4210-ab26-3239e837bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.160016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc00686-bff2-4210-ab26-3239e837bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.160489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc00686-bff2-4210-ab26-3239e837bfc5 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.161952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc00686-bff2-4210-ab26-3239e837bfc5 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:20.163594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc00686-bff2-4210-ab26-3239e837bfc5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:20.165704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 126/250] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:20 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:20.172299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc00686-bff2-4210-ab26-3239e837bfc5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:20.224583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaf45d-9c22-4b87-8044-effea85709fc None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:20.260346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3cb1b-abcb-464a-a703-79b420996483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:20.261027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3cb1b-abcb-464a-a703-79b420996483 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.261311 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3cb1b-abcb-464a-a703-79b420996483 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.261590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3cb1b-abcb-464a-a703-79b420996483 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.262780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3cb1b-abcb-464a-a703-79b420996483 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:20.264435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3cb1b-abcb-464a-a703-79b420996483 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:20.266541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 125/251] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:20 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:20.272901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3cb1b-abcb-464a-a703-79b420996483 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:20.291412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc00686-bff2-4210-ab26-3239e837bfc5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:20.329193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90f94b-f1c0-4ba5-9c42-3147dad1a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:20.330794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90f94b-f1c0-4ba5-9c42-3147dad1a54a None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.331279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90f94b-f1c0-4ba5-9c42-3147dad1a54a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.331776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90f94b-f1c0-4ba5-9c42-3147dad1a54a None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/users/f2a1ea2245a1465e8421a80bf1eac998/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.333385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:20.335506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90f94b-f1c0-4ba5-9c42-3147dad1a54a None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e8d56fbcdf45a684d233aebc7e8b72, user_id=f2a1ea2245a1465e8421a80bf1eac998, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:20.337445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90f94b-f1c0-4ba5-9c42-3147dad1a54a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:20.389047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3cb1b-abcb-464a-a703-79b420996483 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:20.428030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf1d12-b639-4f13-8379-253c9ebec6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:20.428810 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf1d12-b639-4f13-8379-253c9ebec6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.429220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf1d12-b639-4f13-8379-253c9ebec6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.429592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf1d12-b639-4f13-8379-253c9ebec6e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.437152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 127/252] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:47:20 2022] PUT /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/users/f2a1ea2245a1465e8421a80bf1eac998/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:20.437394 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf1d12-b639-4f13-8379-253c9ebec6e4 None admin] RBAC: Adding query filter params (role.id=cfeca18af06d4545b5672877734062d7, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72, user.id=a8b0765987cc473c9ea726d63fd9a91c) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:20.437858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf1d12-b639-4f13-8379-253c9ebec6e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:20.440131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf1d12-b639-4f13-8379-253c9ebec6e4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:20.447269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 126/253] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:20 2022] GET /identity/v3/role_assignments?user.id=a8b0765987cc473c9ea726d63fd9a91c&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=cfeca18af06d4545b5672877734062d7 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:20.635286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7640a99-18e0-4f36-b577-580b8acee5e3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.635798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7640a99-18e0-4f36-b577-580b8acee5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.636268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7640a99-18e0-4f36-b577-580b8acee5e3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.638813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 128/254] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:20.643983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2117e4-e7ab-4b07-b81a-0ee15dacf38f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.644545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2117e4-e7ab-4b07-b81a-0ee15dacf38f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.645043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2117e4-e7ab-4b07-b81a-0ee15dacf38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.667230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8d2117e4-e7ab-4b07-b81a-0ee15dacf38f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:20.668441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8d2117e4-e7ab-4b07-b81a-0ee15dacf38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:20.755709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 127/255] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:20.802292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7640a99-18e0-4f36-b577-580b8acee5e3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:20.858640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:20.935550 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7640a99-18e0-4f36-b577-580b8acee5e3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:20.966997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b71bbe-ec97-4036-96e3-2a938260c1cf None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.967506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b71bbe-ec97-4036-96e3-2a938260c1cf None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.967506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b71bbe-ec97-4036-96e3-2a938260c1cf None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.969302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 128/256] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:20.974271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c5e1-5030-49a0-a6ce-337161cd949c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.974521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c5e1-5030-49a0-a6ce-337161cd949c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.974764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c5e1-5030-49a0-a6ce-337161cd949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.984530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c44e1-82e5-4397-a96b-4276138cd59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:20.985567 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c44e1-82e5-4397-a96b-4276138cd59d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:20.986735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c44e1-82e5-4397-a96b-4276138cd59d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:20.987786 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c44e1-82e5-4397-a96b-4276138cd59d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:20.993283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7cb5c5e1-5030-49a0-a6ce-337161cd949c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:20.994461 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7cb5c5e1-5030-49a0-a6ce-337161cd949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:21.010103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c44e1-82e5-4397-a96b-4276138cd59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bc4c44e1-82e5-4397-a96b-4276138cd59d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:21.024821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:21.025775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:21.026573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 129/257] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:21.033249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c44e1-82e5-4397-a96b-4276138cd59d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:21.087214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:21.126347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 129/258] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:21.191200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5c5e1-5030-49a0-a6ce-337161cd949c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:21.212830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:21.212830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c44e1-82e5-4397-a96b-4276138cd59d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:21.256172 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ea14-91ac-44c1-8d9f-52da92f91b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:21.256977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ea14-91ac-44c1-8d9f-52da92f91b20 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:21.257258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ea14-91ac-44c1-8d9f-52da92f91b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:21.257525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ea14-91ac-44c1-8d9f-52da92f91b20 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:21.258242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ea14-91ac-44c1-8d9f-52da92f91b20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:21.258540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ea14-91ac-44c1-8d9f-52da92f91b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:21.260379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ea14-91ac-44c1-8d9f-52da92f91b20 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:21.275136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 130/259] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:21.280447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ea14-91ac-44c1-8d9f-52da92f91b20 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:21.409829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ea14-91ac-44c1-8d9f-52da92f91b20 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:21.458468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b54c9a-40f7-49c9-8c26-8cd2909511d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:21.459190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b54c9a-40f7-49c9-8c26-8cd2909511d9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:21.459459 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b54c9a-40f7-49c9-8c26-8cd2909511d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:21.459740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b54c9a-40f7-49c9-8c26-8cd2909511d9 None admin] PATH_INFO: `/v3/users/3edade336a344919962137e411fb188d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:21.461020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b54c9a-40f7-49c9-8c26-8cd2909511d9 None admin] RBAC: Authorizing `identity:get_user(user_id=3edade336a344919962137e411fb188d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:21.462639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b54c9a-40f7-49c9-8c26-8cd2909511d9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:21.465005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 131/260] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:21 2022] GET /identity/v3/users/3edade336a344919962137e411fb188d => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:21.470907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b54c9a-40f7-49c9-8c26-8cd2909511d9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:21.513277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:21.538773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5c5e1-5030-49a0-a6ce-337161cd949c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:21.664597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec422e3a-c31a-49fa-be29-7048537a0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:21.665254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec422e3a-c31a-49fa-be29-7048537a0738 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:21.665539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec422e3a-c31a-49fa-be29-7048537a0738 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:21.665811 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec422e3a-c31a-49fa-be29-7048537a0738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:21.667748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b54c9a-40f7-49c9-8c26-8cd2909511d9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:21.697622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec422e3a-c31a-49fa-be29-7048537a0738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-ec422e3a-c31a-49fa-be29-7048537a0738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:21.702589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:21.703462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:21.704248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 130/261] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 513 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:21.710585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec422e3a-c31a-49fa-be29-7048537a0738 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:21.746337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6452e8e-9d22-4b7d-bb61-f8f97f608360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:21.746962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6452e8e-9d22-4b7d-bb61-f8f97f608360 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:21.747243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6452e8e-9d22-4b7d-bb61-f8f97f608360 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:21.747518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6452e8e-9d22-4b7d-bb61-f8f97f608360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:21.815248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:21.897580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6452e8e-9d22-4b7d-bb61-f8f97f608360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:21.899543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6452e8e-9d22-4b7d-bb61-f8f97f608360 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:21.942959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec422e3a-c31a-49fa-be29-7048537a0738 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:21.943452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:22.023384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 132/262] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:22.026198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fe0c3-9e4d-4d1a-9839-3057d9d3d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:22.027376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fe0c3-9e4d-4d1a-9839-3057d9d3d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:22.027854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fe0c3-9e4d-4d1a-9839-3057d9d3d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:22.029023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6452e8e-9d22-4b7d-bb61-f8f97f608360 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:22.032107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fe0c3-9e4d-4d1a-9839-3057d9d3d2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:22.038727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fe0c3-9e4d-4d1a-9839-3057d9d3d2d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:22.039291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fe0c3-9e4d-4d1a-9839-3057d9d3d2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:22.040922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fe0c3-9e4d-4d1a-9839-3057d9d3d2d6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:22.060616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 131/263] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:22.066564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fe0c3-9e4d-4d1a-9839-3057d9d3d2d6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:22.242580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6452e8e-9d22-4b7d-bb61-f8f97f608360 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:22.281209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fe0c3-9e4d-4d1a-9839-3057d9d3d2d6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:22.286384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:22.304550 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:22.315228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121093-3f62-4dc2-b7c1-c1195953fca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:22.318321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121093-3f62-4dc2-b7c1-c1195953fca6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:22.319018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121093-3f62-4dc2-b7c1-c1195953fca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:22.320126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121093-3f62-4dc2-b7c1-c1195953fca6 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:22.321599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99121093-3f62-4dc2-b7c1-c1195953fca6 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:22.323321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99121093-3f62-4dc2-b7c1-c1195953fca6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:22.325242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 133/264] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:22 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:22.331123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121093-3f62-4dc2-b7c1-c1195953fca6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:22.362574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d6e5-2d39-4833-8a64-fe6941bb9054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:22.363191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d6e5-2d39-4833-8a64-fe6941bb9054 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:22.363469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d6e5-2d39-4833-8a64-fe6941bb9054 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:22.363740 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d6e5-2d39-4833-8a64-fe6941bb9054 None admin] PATH_INFO: `/v3/users/3edade336a344919962137e411fb188d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:22.365542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6d6e5-2d39-4833-8a64-fe6941bb9054 None admin] RBAC: Authorizing `identity:get_user(user_id=3edade336a344919962137e411fb188d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:22.367067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6d6e5-2d39-4833-8a64-fe6941bb9054 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:22.369113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 132/265] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:22 2022] GET /identity/v3/users/3edade336a344919962137e411fb188d => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:22.374165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d6e5-2d39-4833-8a64-fe6941bb9054 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:22.437877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121093-3f62-4dc2-b7c1-c1195953fca6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:22.472999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c59cbb-41cd-4c0d-ab8b-79307b72a71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:22.473948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c59cbb-41cd-4c0d-ab8b-79307b72a71d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:22.474471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c59cbb-41cd-4c0d-ab8b-79307b72a71d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:22.474938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c59cbb-41cd-4c0d-ab8b-79307b72a71d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:22.475915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c59cbb-41cd-4c0d-ab8b-79307b72a71d None admin] RBAC: Adding query filter params (role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72, user.id=3edade336a344919962137e411fb188d) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:22.476417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c59cbb-41cd-4c0d-ab8b-79307b72a71d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:22.478075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c59cbb-41cd-4c0d-ab8b-79307b72a71d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:22.484577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 134/266] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:22 2022] GET /identity/v3/role_assignments?user.id=3edade336a344919962137e411fb188d&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:22.579040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d6e5-2d39-4833-8a64-fe6941bb9054 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:22.629914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3923c-0341-4b79-ae5a-9ea7ab38d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:22.630549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3923c-0341-4b79-ae5a-9ea7ab38d757 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:22.630829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3923c-0341-4b79-ae5a-9ea7ab38d757 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:22.631104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3923c-0341-4b79-ae5a-9ea7ab38d757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:22.686596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:22.728663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3923c-0341-4b79-ae5a-9ea7ab38d757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:22.730195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3923c-0341-4b79-ae5a-9ea7ab38d757 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:22.874631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 133/267] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:22.880587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c59cbb-41cd-4c0d-ab8b-79307b72a71d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:22.949668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:22.989874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c59cbb-41cd-4c0d-ab8b-79307b72a71d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:23.029812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7088376-6ede-4360-b6ba-1dbd19dbfbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:23.030471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7088376-6ede-4360-b6ba-1dbd19dbfbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.030753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7088376-6ede-4360-b6ba-1dbd19dbfbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.031027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7088376-6ede-4360-b6ba-1dbd19dbfbf5 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.032195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7088376-6ede-4360-b6ba-1dbd19dbfbf5 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:23.034253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7088376-6ede-4360-b6ba-1dbd19dbfbf5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:23.038938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 135/268] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:22 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:23.044471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3923c-0341-4b79-ae5a-9ea7ab38d757 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:23.124143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:23.154904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3923c-0341-4b79-ae5a-9ea7ab38d757 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:23.207343 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f0eca-d6bf-46c4-bc64-4e147ad4a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:23.207970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0eca-d6bf-46c4-bc64-4e147ad4a00f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.208250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0eca-d6bf-46c4-bc64-4e147ad4a00f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.208521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f0eca-d6bf-46c4-bc64-4e147ad4a00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.209352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f0eca-d6bf-46c4-bc64-4e147ad4a00f None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72, user.id=3edade336a344919962137e411fb188d) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:23.209661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f0eca-d6bf-46c4-bc64-4e147ad4a00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:23.211103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f0eca-d6bf-46c4-bc64-4e147ad4a00f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:23.221967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 134/269] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:23 2022] GET /identity/v3/role_assignments?user.id=3edade336a344919962137e411fb188d&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:23.242651 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f4da9-5dc3-4167-a216-501931ebc326 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.243165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f4da9-5dc3-4167-a216-501931ebc326 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.243239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f4da9-5dc3-4167-a216-501931ebc326 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.244615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 136/270] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:23.250306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab5710-4587-449c-a56a-ae76d1acfc81 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.250616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab5710-4587-449c-a56a-ae76d1acfc81 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.250860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab5710-4587-449c-a56a-ae76d1acfc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.279295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-51ab5710-4587-449c-a56a-ae76d1acfc81 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:23.280534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-51ab5710-4587-449c-a56a-ae76d1acfc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:23.364649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a30094-17c2-444b-913e-7574e8d8cf94 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.365002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a30094-17c2-444b-913e-7574e8d8cf94 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.365236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a30094-17c2-444b-913e-7574e8d8cf94 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.366947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 137/271] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:23.372144 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cba2c-32b6-4f5f-861a-ba4d8515dec9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.372430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cba2c-32b6-4f5f-861a-ba4d8515dec9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.372706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cba2c-32b6-4f5f-861a-ba4d8515dec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.397235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 135/272] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:23.398089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-843cba2c-32b6-4f5f-861a-ba4d8515dec9 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:23.399398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-843cba2c-32b6-4f5f-861a-ba4d8515dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:23.420557 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab5710-4587-449c-a56a-ae76d1acfc81 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:23.475406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 138/273] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:23.476692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147da753-0d32-4659-bd42-5e195cc7da1a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.477004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147da753-0d32-4659-bd42-5e195cc7da1a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.477276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147da753-0d32-4659-bd42-5e195cc7da1a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.478537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 139/274] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:23.486333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e68294-b980-4381-b228-0fcb196969ef None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.486499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e68294-b980-4381-b228-0fcb196969ef None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.486891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e68294-b980-4381-b228-0fcb196969ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.494375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:23.506592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-09e68294-b980-4381-b228-0fcb196969ef None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:23.507794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-09e68294-b980-4381-b228-0fcb196969ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:23.536386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab5710-4587-449c-a56a-ae76d1acfc81 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:23.572381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:23.574185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f884e33-dceb-4fe9-867e-e12a3b96b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:23.574796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884e33-dceb-4fe9-867e-e12a3b96b180 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.575130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884e33-dceb-4fe9-867e-e12a3b96b180 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.575402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f884e33-dceb-4fe9-867e-e12a3b96b180 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.592807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 140/275] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:23.592807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e68294-b980-4381-b228-0fcb196969ef None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:23.594642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f884e33-dceb-4fe9-867e-e12a3b96b180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-2f884e33-dceb-4fe9-867e-e12a3b96b180 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:23.601261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:23.602247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:23.603032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:23.605108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 136/276] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:23.606825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930d6c-269e-42a9-80dc-1bb3287845de None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.607113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930d6c-269e-42a9-80dc-1bb3287845de None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.607601 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930d6c-269e-42a9-80dc-1bb3287845de None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.609098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 137/277] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:23.609802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930d6c-269e-42a9-80dc-1bb3287845de None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:23.687271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e68294-b980-4381-b228-0fcb196969ef None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:23.715553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930d6c-269e-42a9-80dc-1bb3287845de None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:23.719617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5f2a0-2923-47d6-990c-2c8c708367c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:23.720255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5f2a0-2923-47d6-990c-2c8c708367c9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.721073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5f2a0-2923-47d6-990c-2c8c708367c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.721348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5f2a0-2923-47d6-990c-2c8c708367c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.731487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5f2a0-2923-47d6-990c-2c8c708367c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-13a5f2a0-2923-47d6-990c-2c8c708367c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:23.738108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:23.739186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 141/278] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:23.740112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5f2a0-2923-47d6-990c-2c8c708367c9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:23.742342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:23.753723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479de27-f18d-4da5-b0e8-b36877251ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:23.754326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479de27-f18d-4da5-b0e8-b36877251ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.754601 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479de27-f18d-4da5-b0e8-b36877251ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.754868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479de27-f18d-4da5-b0e8-b36877251ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.755582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479de27-f18d-4da5-b0e8-b36877251ff7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:23.755875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479de27-f18d-4da5-b0e8-b36877251ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:23.757285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479de27-f18d-4da5-b0e8-b36877251ff7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:23.765217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 138/279] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:23.766353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba281113-59d4-41b0-a0e6-d65ece24b71f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.766632 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba281113-59d4-41b0-a0e6-d65ece24b71f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.766901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba281113-59d4-41b0-a0e6-d65ece24b71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.784540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ba281113-59d4-41b0-a0e6-d65ece24b71f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:23.785739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ba281113-59d4-41b0-a0e6-d65ece24b71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:23.796377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:23.844625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5f2a0-2923-47d6-990c-2c8c708367c9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:23.851153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 139/280] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:23.857749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba281113-59d4-41b0-a0e6-d65ece24b71f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:23.882112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c96147-4ff0-4db7-87ff-2b56b8dd1133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:23.882739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c96147-4ff0-4db7-87ff-2b56b8dd1133 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.883010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c96147-4ff0-4db7-87ff-2b56b8dd1133 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.883276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c96147-4ff0-4db7-87ff-2b56b8dd1133 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.893552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c96147-4ff0-4db7-87ff-2b56b8dd1133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-38c96147-4ff0-4db7-87ff-2b56b8dd1133 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:23.898478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:23.899392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 142/281] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:23.905397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c96147-4ff0-4db7-87ff-2b56b8dd1133 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:23.955978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba281113-59d4-41b0-a0e6-d65ece24b71f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:23.973484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:23.991902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f4d3c-bc9c-4775-9aef-14dbf71077f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:23.992510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f4d3c-bc9c-4775-9aef-14dbf71077f4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:23.992798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f4d3c-bc9c-4775-9aef-14dbf71077f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:23.993076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f4d3c-bc9c-4775-9aef-14dbf71077f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:23.993784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f4d3c-bc9c-4775-9aef-14dbf71077f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:23.994088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f4d3c-bc9c-4775-9aef-14dbf71077f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:23.995447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f4d3c-bc9c-4775-9aef-14dbf71077f4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:23.996743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c96147-4ff0-4db7-87ff-2b56b8dd1133 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.004427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 140/282] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:24.005233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f4d3c-bc9c-4775-9aef-14dbf71077f4 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.012283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:24.035336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aa050-938d-4ed0-ac8b-a9cc8124b8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.036004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aa050-938d-4ed0-ac8b-a9cc8124b8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.036250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aa050-938d-4ed0-ac8b-a9cc8124b8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.036519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aa050-938d-4ed0-ac8b-a9cc8124b8b6 None admin] PATH_INFO: `/v3/users/a8b0765987cc473c9ea726d63fd9a91c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.037714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aa050-938d-4ed0-ac8b-a9cc8124b8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=a8b0765987cc473c9ea726d63fd9a91c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.039360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aa050-938d-4ed0-ac8b-a9cc8124b8b6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.040927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 143/283] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:23 2022] GET /identity/v3/users/a8b0765987cc473c9ea726d63fd9a91c => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:24.041610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aa050-938d-4ed0-ac8b-a9cc8124b8b6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.103108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f4d3c-bc9c-4775-9aef-14dbf71077f4 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.136045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaae49-98a0-43bf-9c07-cf1640a9bb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.136673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaae49-98a0-43bf-9c07-cf1640a9bb74 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.136982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaae49-98a0-43bf-9c07-cf1640a9bb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.137254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaae49-98a0-43bf-9c07-cf1640a9bb74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.138272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aa050-938d-4ed0-ac8b-a9cc8124b8b6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.138393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaae49-98a0-43bf-9c07-cf1640a9bb74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.139809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaae49-98a0-43bf-9c07-cf1640a9bb74 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.141417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 141/284] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:24.142167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaae49-98a0-43bf-9c07-cf1640a9bb74 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.177858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b922-e792-453a-948d-a27296e4f10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.178476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b922-e792-453a-948d-a27296e4f10b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.178753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b922-e792-453a-948d-a27296e4f10b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.179023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b922-e792-453a-948d-a27296e4f10b None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.179734 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1b922-e792-453a-948d-a27296e4f10b None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:24.180038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1b922-e792-453a-948d-a27296e4f10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.181434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1b922-e792-453a-948d-a27296e4f10b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.189700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 144/285] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:24.190475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b922-e792-453a-948d-a27296e4f10b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.192505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:24.231068 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:24.246877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaae49-98a0-43bf-9c07-cf1640a9bb74 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.279297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f4441-71f9-4c0b-b19d-34d21f4fe5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.279927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f4441-71f9-4c0b-b19d-34d21f4fe5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.280205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f4441-71f9-4c0b-b19d-34d21f4fe5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.280479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f4441-71f9-4c0b-b19d-34d21f4fe5f9 None admin] PATH_INFO: `/v3/users/f2a1ea2245a1465e8421a80bf1eac998` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.281669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f4441-71f9-4c0b-b19d-34d21f4fe5f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a1ea2245a1465e8421a80bf1eac998)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.283640 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f4441-71f9-4c0b-b19d-34d21f4fe5f9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.285276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 142/286] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:24 2022] GET /identity/v3/users/f2a1ea2245a1465e8421a80bf1eac998 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:24.286019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f4441-71f9-4c0b-b19d-34d21f4fe5f9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.287661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b922-e792-453a-948d-a27296e4f10b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.322277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91a293-6b35-434e-befd-b931e40d5cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.322915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91a293-6b35-434e-befd-b931e40d5cff None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.323196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91a293-6b35-434e-befd-b931e40d5cff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.323470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91a293-6b35-434e-befd-b931e40d5cff None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.324617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91a293-6b35-434e-befd-b931e40d5cff None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.326083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91a293-6b35-434e-befd-b931e40d5cff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.327736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 145/287] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:24 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:24.328498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91a293-6b35-434e-befd-b931e40d5cff None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.385926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f4441-71f9-4c0b-b19d-34d21f4fe5f9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.398938 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:24.420242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ef11d-f18b-4a21-9293-83cec7c6e2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.421129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ef11d-f18b-4a21-9293-83cec7c6e2c3 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.421129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ef11d-f18b-4a21-9293-83cec7c6e2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.421403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ef11d-f18b-4a21-9293-83cec7c6e2c3 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.422077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ef11d-f18b-4a21-9293-83cec7c6e2c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.423525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ef11d-f18b-4a21-9293-83cec7c6e2c3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.430100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91a293-6b35-434e-befd-b931e40d5cff None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.439323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:24.462748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a385aa-000b-4575-9410-abd78282d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.463378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a385aa-000b-4575-9410-abd78282d789 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.463655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a385aa-000b-4575-9410-abd78282d789 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.463925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a385aa-000b-4575-9410-abd78282d789 None admin] PATH_INFO: `/v3/users/3fdfb9e9716340cb8a894b804b7f01cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.477694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a385aa-000b-4575-9410-abd78282d789 None admin] RBAC: Authorizing `identity:get_user(user_id=3fdfb9e9716340cb8a894b804b7f01cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.479140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a385aa-000b-4575-9410-abd78282d789 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.480731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 146/288] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:24 2022] GET /identity/v3/users/3fdfb9e9716340cb8a894b804b7f01cb => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:24.481580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a385aa-000b-4575-9410-abd78282d789 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.544814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 143/289] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:24 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:24.544814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ef11d-f18b-4a21-9293-83cec7c6e2c3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.587579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a385aa-000b-4575-9410-abd78282d789 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.627278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd7ac-8c26-41ec-8b6a-ab34b4128e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.627905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd7ac-8c26-41ec-8b6a-ab34b4128e8a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.628187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd7ac-8c26-41ec-8b6a-ab34b4128e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.628459 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdd7ac-8c26-41ec-8b6a-ab34b4128e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.641897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ef11d-f18b-4a21-9293-83cec7c6e2c3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.666472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:24.679583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dcd5c-a03c-4f63-95a3-98a8d6737f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.680269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcd5c-a03c-4f63-95a3-98a8d6737f4c None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.680549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcd5c-a03c-4f63-95a3-98a8d6737f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.680861 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcd5c-a03c-4f63-95a3-98a8d6737f4c None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/users/a8b0765987cc473c9ea726d63fd9a91c/roles/cfeca18af06d4545b5672877734062d7` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.683243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcd5c-a03c-4f63-95a3-98a8d6737f4c None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e8d56fbcdf45a684d233aebc7e8b72, user_id=a8b0765987cc473c9ea726d63fd9a91c, role_id=cfeca18af06d4545b5672877734062d7)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.684296 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcd5c-a03c-4f63-95a3-98a8d6737f4c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.706860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdd7ac-8c26-41ec-8b6a-ab34b4128e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.708320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdd7ac-8c26-41ec-8b6a-ab34b4128e8a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.783516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 144/290] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:47:24 2022] PUT /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/users/a8b0765987cc473c9ea726d63fd9a91c/roles/cfeca18af06d4545b5672877734062d7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:24.784636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dcd5c-a03c-4f63-95a3-98a8d6737f4c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.826277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 147/291] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:24.832032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd7ac-8c26-41ec-8b6a-ab34b4128e8a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:24.833676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:24.925182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:24.934114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dcd5c-a03c-4f63-95a3-98a8d6737f4c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.971006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdd7ac-8c26-41ec-8b6a-ab34b4128e8a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:24.981607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8c106-9678-4181-8e97-ecdc41796c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:24.982237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8c106-9678-4181-8e97-ecdc41796c2e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:24.982896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8c106-9678-4181-8e97-ecdc41796c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:24.983187 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8c106-9678-4181-8e97-ecdc41796c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:24.984292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8c106-9678-4181-8e97-ecdc41796c2e None admin] RBAC: Adding query filter params (role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, user.id=3fdfb9e9716340cb8a894b804b7f01cb, scope.system=all) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:24.984627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8c106-9678-4181-8e97-ecdc41796c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:24.987121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8c106-9678-4181-8e97-ecdc41796c2e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:24.994317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 145/292] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 28 17:47:24 2022] GET /identity/v3/role_assignments?user.id=3fdfb9e9716340cb8a894b804b7f01cb&scope.system=all&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:25.041032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabd01e-7855-4f7c-b764-ac21cde2e6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:25.041931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabd01e-7855-4f7c-b764-ac21cde2e6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:25.042375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabd01e-7855-4f7c-b764-ac21cde2e6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:25.042804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabd01e-7855-4f7c-b764-ac21cde2e6a7 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:25.044224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabd01e-7855-4f7c-b764-ac21cde2e6a7 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:25.045875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabd01e-7855-4f7c-b764-ac21cde2e6a7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:25.047769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 148/293] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:24 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:25.053891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8c106-9678-4181-8e97-ecdc41796c2e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:25.178740 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:25.186667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8c106-9678-4181-8e97-ecdc41796c2e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:25.223219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354511-8bbd-49bc-9456-810dfe0f3718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:25.223843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354511-8bbd-49bc-9456-810dfe0f3718 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:25.224125 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354511-8bbd-49bc-9456-810dfe0f3718 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:25.224410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354511-8bbd-49bc-9456-810dfe0f3718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:25.225244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354511-8bbd-49bc-9456-810dfe0f3718 None admin] RBAC: Adding query filter params (role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72, user.id=f2a1ea2245a1465e8421a80bf1eac998) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:25.225556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354511-8bbd-49bc-9456-810dfe0f3718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:25.226999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354511-8bbd-49bc-9456-810dfe0f3718 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:25.233233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 146/294] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:25 2022] GET /identity/v3/role_assignments?user.id=f2a1ea2245a1465e8421a80bf1eac998&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:26.866197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300439a9-1b74-4586-9b2d-1990644f42ee None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:26.866821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300439a9-1b74-4586-9b2d-1990644f42ee None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:26.866821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300439a9-1b74-4586-9b2d-1990644f42ee None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:26.868209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 149/295] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:26.873542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8406-adaf-4d08-a8b4-9b3f30069e45 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:26.873962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8406-adaf-4d08-a8b4-9b3f30069e45 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:26.874136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8406-adaf-4d08-a8b4-9b3f30069e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:26.895623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-0abc8406-adaf-4d08-a8b4-9b3f30069e45 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:26.896854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0abc8406-adaf-4d08-a8b4-9b3f30069e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:26.962013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2ca3-5480-4f7a-a7e5-1fe1bde72541 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:26.962327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2ca3-5480-4f7a-a7e5-1fe1bde72541 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:26.962571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2ca3-5480-4f7a-a7e5-1fe1bde72541 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:26.964175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 150/296] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:26.968436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 147/297] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:26.968913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000ba1e-7e3f-4b69-b38e-0df05bc6a9c0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:26.969200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000ba1e-7e3f-4b69-b38e-0df05bc6a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:26.969476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000ba1e-7e3f-4b69-b38e-0df05bc6a9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:26.987885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3000ba1e-7e3f-4b69-b38e-0df05bc6a9c0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:26.989106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3000ba1e-7e3f-4b69-b38e-0df05bc6a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:26.991436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc8406-adaf-4d08-a8b4-9b3f30069e45 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.058169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 151/298] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:27.066098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8d31c-c74c-4d14-af43-27b7d6b3784e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.066389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8d31c-c74c-4d14-af43-27b7d6b3784e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.066664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8d31c-c74c-4d14-af43-27b7d6b3784e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.067940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 152/299] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:27.073948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a348f-34bc-48b8-b4a8-8f2a1bd89256 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.074306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a348f-34bc-48b8-b4a8-8f2a1bd89256 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.074666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a348f-34bc-48b8-b4a8-8f2a1bd89256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.090344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:27.097669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-801a348f-34bc-48b8-b4a8-8f2a1bd89256 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:27.098868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-801a348f-34bc-48b8-b4a8-8f2a1bd89256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:27.104068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc8406-adaf-4d08-a8b4-9b3f30069e45 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:27.140319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcefd2-b32b-4169-b05d-e1a848194036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:27.140916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcefd2-b32b-4169-b05d-e1a848194036 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.141196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcefd2-b32b-4169-b05d-e1a848194036 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.141463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcefd2-b32b-4169-b05d-e1a848194036 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.142748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcefd2-b32b-4169-b05d-e1a848194036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:27.144596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcefd2-b32b-4169-b05d-e1a848194036 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:27.146732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 148/300] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:27.147977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcefd2-b32b-4169-b05d-e1a848194036 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.165597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:27.176722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 153/301] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:27.190972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a348f-34bc-48b8-b4a8-8f2a1bd89256 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.250413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcefd2-b32b-4169-b05d-e1a848194036 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:27.278470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a348f-34bc-48b8-b4a8-8f2a1bd89256 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:27.284412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690048a9-d8ef-4f67-9205-b54ae6295546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:27.285071 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690048a9-d8ef-4f67-9205-b54ae6295546 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.285437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690048a9-d8ef-4f67-9205-b54ae6295546 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.285717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690048a9-d8ef-4f67-9205-b54ae6295546 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.295678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690048a9-d8ef-4f67-9205-b54ae6295546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-690048a9-d8ef-4f67-9205-b54ae6295546 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:27.300666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:27.301691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:27.302508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:27.306504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 149/302] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:27.306504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1a34-74fa-4c31-a6d6-579f940c7fb2 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.306921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1a34-74fa-4c31-a6d6-579f940c7fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.307206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1a34-74fa-4c31-a6d6-579f940c7fb2 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.308478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 150/303] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:27.309282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb1a34-74fa-4c31-a6d6-579f940c7fb2 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.312866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0bbfa-90c6-444f-84e0-7b2b01fcdf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:27.313496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0bbfa-90c6-444f-84e0-7b2b01fcdf91 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.313780 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0bbfa-90c6-444f-84e0-7b2b01fcdf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.314060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0bbfa-90c6-444f-84e0-7b2b01fcdf91 None admin] PATH_INFO: `/v3/groups` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.315215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0bbfa-90c6-444f-84e0-7b2b01fcdf91 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:27.316658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0bbfa-90c6-444f-84e0-7b2b01fcdf91 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:27.328236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:27.390574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 154/304] 10.222.0.67 () {60 vars in 1134 bytes} [Thu Jul 28 17:47:27 2022] POST /identity/v3/groups => generated 229 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:27.391504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0bbfa-90c6-444f-84e0-7b2b01fcdf91 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.412139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb1a34-74fa-4c31-a6d6-579f940c7fb2 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:27.453920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02329f18-a015-4144-84be-fc219d08b1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:27.454574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329f18-a015-4144-84be-fc219d08b1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.455440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329f18-a015-4144-84be-fc219d08b1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.455750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329f18-a015-4144-84be-fc219d08b1f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.460033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:27.468993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02329f18-a015-4144-84be-fc219d08b1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-02329f18-a015-4144-84be-fc219d08b1f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:27.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:27.475233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:27.476017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 151/305] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:27.477199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5df33-dd84-465f-b23a-d7d0261e10a1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.477199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5df33-dd84-465f-b23a-d7d0261e10a1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.477637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5df33-dd84-465f-b23a-d7d0261e10a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.496324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-14f5df33-dd84-465f-b23a-d7d0261e10a1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:27.497576 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-14f5df33-dd84-465f-b23a-d7d0261e10a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:27.517504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0bbfa-90c6-444f-84e0-7b2b01fcdf91 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:27.559129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d4719-162a-472d-87e7-f7195a5c8098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:27.560341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4719-162a-472d-87e7-f7195a5c8098 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.560626 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4719-162a-472d-87e7-f7195a5c8098 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.561010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d4719-162a-472d-87e7-f7195a5c8098 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.562212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d4719-162a-472d-87e7-f7195a5c8098 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:27.562755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d4719-162a-472d-87e7-f7195a5c8098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:27.565550 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d4719-162a-472d-87e7-f7195a5c8098 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:27.577805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 155/306] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:27.578461 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d4719-162a-472d-87e7-f7195a5c8098 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.583961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 152/307] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:27.585218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5df33-dd84-465f-b23a-d7d0261e10a1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.593546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:27.691675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d4719-162a-472d-87e7-f7195a5c8098 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:27.698727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5df33-dd84-465f-b23a-d7d0261e10a1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:27.708839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:27.727254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71351a62-ddb4-4947-94fa-d1d86b0b1f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:27.727870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71351a62-ddb4-4947-94fa-d1d86b0b1f9c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.728148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71351a62-ddb4-4947-94fa-d1d86b0b1f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.728424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71351a62-ddb4-4947-94fa-d1d86b0b1f9c None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.728715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f1ae6-67f9-406d-8b4b-4586d0a6e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:27.729171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71351a62-ddb4-4947-94fa-d1d86b0b1f9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:27.729373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f1ae6-67f9-406d-8b4b-4586d0a6e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.729482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71351a62-ddb4-4947-94fa-d1d86b0b1f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:27.729641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f1ae6-67f9-406d-8b4b-4586d0a6e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.729909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f1ae6-67f9-406d-8b4b-4586d0a6e1b0 None admin] PATH_INFO: `/v3/users/0fb1151204d84b75a69079a8cb7981b8` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.730830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71351a62-ddb4-4947-94fa-d1d86b0b1f9c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:27.743707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f1ae6-67f9-406d-8b4b-4586d0a6e1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=0fb1151204d84b75a69079a8cb7981b8)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:27.744483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 156/308] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:27.745204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f1ae6-67f9-406d-8b4b-4586d0a6e1b0 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:27.745480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71351a62-ddb4-4947-94fa-d1d86b0b1f9c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.751934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 153/309] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:27 2022] GET /identity/v3/users/0fb1151204d84b75a69079a8cb7981b8 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:27.752451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f1ae6-67f9-406d-8b4b-4586d0a6e1b0 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.818692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:27.855257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f1ae6-67f9-406d-8b4b-4586d0a6e1b0 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:27.891786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329fd1a-43b9-43f0-921c-12cf6ebb19a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:27.892466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329fd1a-43b9-43f0-921c-12cf6ebb19a2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.892748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329fd1a-43b9-43f0-921c-12cf6ebb19a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.893183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329fd1a-43b9-43f0-921c-12cf6ebb19a2 None admin] PATH_INFO: `/v3/users/a8b0765987cc473c9ea726d63fd9a91c` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.894343 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329fd1a-43b9-43f0-921c-12cf6ebb19a2 None admin] RBAC: Authorizing `identity:get_user(user_id=a8b0765987cc473c9ea726d63fd9a91c)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:27.895793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329fd1a-43b9-43f0-921c-12cf6ebb19a2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:27.896625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71351a62-ddb4-4947-94fa-d1d86b0b1f9c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:27.897595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 154/310] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:27 2022] GET /identity/v3/users/a8b0765987cc473c9ea726d63fd9a91c => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:27.898279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329fd1a-43b9-43f0-921c-12cf6ebb19a2 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:27.936558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cfbc2-1c92-40cf-b4c1-3d68d24f2f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:27.937250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cfbc2-1c92-40cf-b4c1-3d68d24f2f3e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:27.937534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cfbc2-1c92-40cf-b4c1-3d68d24f2f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:27.937808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cfbc2-1c92-40cf-b4c1-3d68d24f2f3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:27.949279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cfbc2-1c92-40cf-b4c1-3d68d24f2f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4f4cfbc2-1c92-40cf-b4c1-3d68d24f2f3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:27.954264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:27.955222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:27.956064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 157/311] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:27.956822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cfbc2-1c92-40cf-b4c1-3d68d24f2f3e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:28.002880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:28.030469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329fd1a-43b9-43f0-921c-12cf6ebb19a2 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:28.061417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:28.066352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fff6f-ab2a-4bc1-a97e-9b8efc52410d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:28.066970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fff6f-ab2a-4bc1-a97e-9b8efc52410d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.067252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fff6f-ab2a-4bc1-a97e-9b8efc52410d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.067528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fff6f-ab2a-4bc1-a97e-9b8efc52410d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.068320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fff6f-ab2a-4bc1-a97e-9b8efc52410d None admin] RBAC: Adding query filter params (role.id=cfeca18af06d4545b5672877734062d7, user.id=0fb1151204d84b75a69079a8cb7981b8, scope.system=all) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:28.068632 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fff6f-ab2a-4bc1-a97e-9b8efc52410d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:28.069578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cfbc2-1c92-40cf-b4c1-3d68d24f2f3e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:28.070100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fff6f-ab2a-4bc1-a97e-9b8efc52410d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:28.075350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 155/312] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 28 17:47:27 2022] GET /identity/v3/role_assignments?user.id=0fb1151204d84b75a69079a8cb7981b8&scope.system=all&role.id=cfeca18af06d4545b5672877734062d7 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:28.075952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fff6f-ab2a-4bc1-a97e-9b8efc52410d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:28.133011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ff3f-b73c-4ee5-a7d6-60f7ae87cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:28.133664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ff3f-b73c-4ee5-a7d6-60f7ae87cee9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.133949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ff3f-b73c-4ee5-a7d6-60f7ae87cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.134229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ff3f-b73c-4ee5-a7d6-60f7ae87cee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.219755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fff6f-ab2a-4bc1-a97e-9b8efc52410d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:28.238004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ff3f-b73c-4ee5-a7d6-60f7ae87cee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:28.240128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ff3f-b73c-4ee5-a7d6-60f7ae87cee9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:28.257549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2652d4-60cf-4041-a03a-50eedf933544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:28.258167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2652d4-60cf-4041-a03a-50eedf933544 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.258449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2652d4-60cf-4041-a03a-50eedf933544 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.258718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2652d4-60cf-4041-a03a-50eedf933544 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.259428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2652d4-60cf-4041-a03a-50eedf933544 None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:28.259727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2652d4-60cf-4041-a03a-50eedf933544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:28.261142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2652d4-60cf-4041-a03a-50eedf933544 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:28.273032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 156/313] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:28.275005 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2652d4-60cf-4041-a03a-50eedf933544 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:28.293216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:28.341153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:28.371963 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 158/314] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:28.377061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ff3f-b73c-4ee5-a7d6-60f7ae87cee9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:28.394702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2652d4-60cf-4041-a03a-50eedf933544 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:28.437464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded12db-9c9f-4a4e-9e67-be06ee226aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:28.438233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded12db-9c9f-4a4e-9e67-be06ee226aba None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.438521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded12db-9c9f-4a4e-9e67-be06ee226aba None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.438796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded12db-9c9f-4a4e-9e67-be06ee226aba None admin] PATH_INFO: `/v3/users/3fdfb9e9716340cb8a894b804b7f01cb` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.440342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded12db-9c9f-4a4e-9e67-be06ee226aba None admin] RBAC: Authorizing `identity:get_user(user_id=3fdfb9e9716340cb8a894b804b7f01cb)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:28.442303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded12db-9c9f-4a4e-9e67-be06ee226aba None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:28.444553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 157/315] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:28 2022] GET /identity/v3/users/3fdfb9e9716340cb8a894b804b7f01cb => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:28.449566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded12db-9c9f-4a4e-9e67-be06ee226aba None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:28.515216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ff3f-b73c-4ee5-a7d6-60f7ae87cee9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:28.561446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a0e05-e7ca-44de-bb9c-7aa94c4a0b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:28.562347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a0e05-e7ca-44de-bb9c-7aa94c4a0b09 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.562777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a0e05-e7ca-44de-bb9c-7aa94c4a0b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.562935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded12db-9c9f-4a4e-9e67-be06ee226aba None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:28.563479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a0e05-e7ca-44de-bb9c-7aa94c4a0b09 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.566115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a0e05-e7ca-44de-bb9c-7aa94c4a0b09 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:28.567776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a0e05-e7ca-44de-bb9c-7aa94c4a0b09 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:28.570127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 159/316] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:28 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:28.577917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a0e05-e7ca-44de-bb9c-7aa94c4a0b09 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:28.587798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:28.598336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:28.607567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47100a8f-1ce1-4ebf-ba07-fa98cd92163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:28.608218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100a8f-1ce1-4ebf-ba07-fa98cd92163c None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.608501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100a8f-1ce1-4ebf-ba07-fa98cd92163c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.608776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100a8f-1ce1-4ebf-ba07-fa98cd92163c None admin] PATH_INFO: `/v3/system/users/3fdfb9e9716340cb8a894b804b7f01cb/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.610371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47100a8f-1ce1-4ebf-ba07-fa98cd92163c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3fdfb9e9716340cb8a894b804b7f01cb, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:28.612524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47100a8f-1ce1-4ebf-ba07-fa98cd92163c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:28.688732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a0e05-e7ca-44de-bb9c-7aa94c4a0b09 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:28.710223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 158/317] 10.222.0.67 () {58 vars in 1334 bytes} [Thu Jul 28 17:47:28 2022] PUT /identity/v3/system/users/3fdfb9e9716340cb8a894b804b7f01cb/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:28.732060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f9abf-2d0c-4c7d-a1b6-277031b8a468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:28.732754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f9abf-2d0c-4c7d-a1b6-277031b8a468 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:28.733078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f9abf-2d0c-4c7d-a1b6-277031b8a468 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:28.733353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f9abf-2d0c-4c7d-a1b6-277031b8a468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:28.734298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f9abf-2d0c-4c7d-a1b6-277031b8a468 None admin] RBAC: Adding query filter params (role.id=cfeca18af06d4545b5672877734062d7, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72, user.id=a8b0765987cc473c9ea726d63fd9a91c) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:28.734681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f9abf-2d0c-4c7d-a1b6-277031b8a468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:28.736719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f9abf-2d0c-4c7d-a1b6-277031b8a468 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:28.744685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 160/318] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:28 2022] GET /identity/v3/role_assignments?user.id=a8b0765987cc473c9ea726d63fd9a91c&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=cfeca18af06d4545b5672877734062d7 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:29.505811 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8988772-b04c-4faf-86da-bfd1266c0ba5 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:29.506298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8988772-b04c-4faf-86da-bfd1266c0ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:29.506298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8988772-b04c-4faf-86da-bfd1266c0ba5 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:29.507796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 159/319] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:29.512985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79bcaa-2fab-480e-84df-fef50b7cfb46 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:29.513392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79bcaa-2fab-480e-84df-fef50b7cfb46 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:29.513581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79bcaa-2fab-480e-84df-fef50b7cfb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:29.531341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5a79bcaa-2fab-480e-84df-fef50b7cfb46 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:29.532584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5a79bcaa-2fab-480e-84df-fef50b7cfb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:29.712668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:29.717781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 161/320] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:29.740688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8988772-b04c-4faf-86da-bfd1266c0ba5 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:29.849203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8988772-b04c-4faf-86da-bfd1266c0ba5 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:29.882710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f4796-bcc4-4477-8fe2-fc8ea51908e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:29.883350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f4796-bcc4-4477-8fe2-fc8ea51908e3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:29.883628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f4796-bcc4-4477-8fe2-fc8ea51908e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:29.883902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f4796-bcc4-4477-8fe2-fc8ea51908e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:29.885090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f4796-bcc4-4477-8fe2-fc8ea51908e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:29.886564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f4796-bcc4-4477-8fe2-fc8ea51908e3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:29.888399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 160/321] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:29.894240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79bcaa-2fab-480e-84df-fef50b7cfb46 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:29.994781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79bcaa-2fab-480e-84df-fef50b7cfb46 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:30.028336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2cd01-f4ce-4446-bdf9-6316445cba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:30.028987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2cd01-f4ce-4446-bdf9-6316445cba70 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:30.029268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2cd01-f4ce-4446-bdf9-6316445cba70 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:30.029541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2cd01-f4ce-4446-bdf9-6316445cba70 None admin] PATH_INFO: `/v3/groups` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:30.030207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2cd01-f4ce-4446-bdf9-6316445cba70 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:30.031642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2cd01-f4ce-4446-bdf9-6316445cba70 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:30.110457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659670-5b2d-4fba-8056-3bca8b43ec45 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:30.110663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659670-5b2d-4fba-8056-3bca8b43ec45 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:30.111430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659670-5b2d-4fba-8056-3bca8b43ec45 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:30.112894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 161/322] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:30.117770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dde938-ad8e-4123-9f32-49fbe33cee9f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:30.118057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dde938-ad8e-4123-9f32-49fbe33cee9f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:30.118327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dde938-ad8e-4123-9f32-49fbe33cee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:30.127645 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 162/323] 10.222.0.67 () {60 vars in 1134 bytes} [Thu Jul 28 17:47:29 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:30.138222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b8dde938-ad8e-4123-9f32-49fbe33cee9f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:30.139440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b8dde938-ad8e-4123-9f32-49fbe33cee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:30.208390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:30.224404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 162/324] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:30.246891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2cd01-f4ce-4446-bdf9-6316445cba70 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:30.314898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:30.356183 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2cd01-f4ce-4446-bdf9-6316445cba70 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:30.392164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a58ed2-3a86-4f65-b103-daca5925fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:30.393208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58ed2-3a86-4f65-b103-daca5925fd66 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:30.393671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58ed2-3a86-4f65-b103-daca5925fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:30.394158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58ed2-3a86-4f65-b103-daca5925fd66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:30.405187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a58ed2-3a86-4f65-b103-daca5925fd66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-66a58ed2-3a86-4f65-b103-daca5925fd66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:30.411703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:30.412762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:30.413568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:30.414464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 163/325] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:30.420134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dde938-ad8e-4123-9f32-49fbe33cee9f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:30.523911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dde938-ad8e-4123-9f32-49fbe33cee9f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:30.561346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3eb98-78e1-4bea-8003-371fdf6fa42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:30.561969 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3eb98-78e1-4bea-8003-371fdf6fa42d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:30.562247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3eb98-78e1-4bea-8003-371fdf6fa42d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:30.562516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3eb98-78e1-4bea-8003-371fdf6fa42d None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:30.563268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3eb98-78e1-4bea-8003-371fdf6fa42d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:30.563568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3eb98-78e1-4bea-8003-371fdf6fa42d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:30.564998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3eb98-78e1-4bea-8003-371fdf6fa42d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:30.573977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 163/326] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:30.579450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a58ed2-3a86-4f65-b103-daca5925fd66 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:30.688290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a58ed2-3a86-4f65-b103-daca5925fd66 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:30.710148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:30.725397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850dd96-e205-44a0-a741-d85f89578cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:30.726041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850dd96-e205-44a0-a741-d85f89578cdc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:30.726316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850dd96-e205-44a0-a741-d85f89578cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:30.726634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850dd96-e205-44a0-a741-d85f89578cdc None admin] PATH_INFO: `/v3/users/0fb1151204d84b75a69079a8cb7981b8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:30.727938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850dd96-e205-44a0-a741-d85f89578cdc None admin] RBAC: Authorizing `identity:get_user(user_id=0fb1151204d84b75a69079a8cb7981b8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:30.729428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850dd96-e205-44a0-a741-d85f89578cdc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:30.731338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 164/327] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:30 2022] GET /identity/v3/users/0fb1151204d84b75a69079a8cb7981b8 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:30.737290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3eb98-78e1-4bea-8003-371fdf6fa42d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:30.776090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e35b-a769-4cc4-9e2a-b20aa154ffd5 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:30.776419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e35b-a769-4cc4-9e2a-b20aa154ffd5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:30.776648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e35b-a769-4cc4-9e2a-b20aa154ffd5 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:30.778155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 165/328] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:30.784614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b9e59-7b05-46e8-80a7-77a97d9c2c31 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:30.784955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b9e59-7b05-46e8-80a7-77a97d9c2c31 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:30.785196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b9e59-7b05-46e8-80a7-77a97d9c2c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:30.801585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:30.806512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-402b9e59-7b05-46e8-80a7-77a97d9c2c31 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:30.807696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-402b9e59-7b05-46e8-80a7-77a97d9c2c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:30.865672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3eb98-78e1-4bea-8003-371fdf6fa42d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:30.892271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 166/329] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:30.916134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b9e59-7b05-46e8-80a7-77a97d9c2c31 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:30.918264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627100-ecc6-4215-954e-7152bffadba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:30.920073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627100-ecc6-4215-954e-7152bffadba6 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:30.920581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627100-ecc6-4215-954e-7152bffadba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:30.921083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627100-ecc6-4215-954e-7152bffadba6 None admin] PATH_INFO: `/v3/system/users/0fb1151204d84b75a69079a8cb7981b8/roles/cfeca18af06d4545b5672877734062d7` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:30.922846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627100-ecc6-4215-954e-7152bffadba6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0fb1151204d84b75a69079a8cb7981b8, role_id=cfeca18af06d4545b5672877734062d7)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:30.925561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627100-ecc6-4215-954e-7152bffadba6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:31.041521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 164/330] 10.222.0.67 () {58 vars in 1334 bytes} [Thu Jul 28 17:47:30 2022] PUT /identity/v3/system/users/0fb1151204d84b75a69079a8cb7981b8/roles/cfeca18af06d4545b5672877734062d7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:31.045576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b9e59-7b05-46e8-80a7-77a97d9c2c31 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:31.069533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:31.088712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aae4d4-990f-4fa3-a7c7-fe5927faad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:31.089784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aae4d4-990f-4fa3-a7c7-fe5927faad2d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:31.090320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aae4d4-990f-4fa3-a7c7-fe5927faad2d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:31.090840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aae4d4-990f-4fa3-a7c7-fe5927faad2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:31.103330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aae4d4-990f-4fa3-a7c7-fe5927faad2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a8aae4d4-990f-4fa3-a7c7-fe5927faad2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:31.109531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:31.110449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:31.111327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:31.113619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 167/331] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:31.119994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627100-ecc6-4215-954e-7152bffadba6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:31.258921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627100-ecc6-4215-954e-7152bffadba6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:31.277227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:31.302291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5a0f1-2ba1-44cd-8b22-87ecfc3c5806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:31.302845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5a0f1-2ba1-44cd-8b22-87ecfc3c5806 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:31.303121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5a0f1-2ba1-44cd-8b22-87ecfc3c5806 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:31.303389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5a0f1-2ba1-44cd-8b22-87ecfc3c5806 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:31.304186 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5a0f1-2ba1-44cd-8b22-87ecfc3c5806 None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:31.304487 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5a0f1-2ba1-44cd-8b22-87ecfc3c5806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:31.305919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5a0f1-2ba1-44cd-8b22-87ecfc3c5806 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:31.322544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 165/332] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:31.328291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aae4d4-990f-4fa3-a7c7-fe5927faad2d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:31.452179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aae4d4-990f-4fa3-a7c7-fe5927faad2d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:31.492020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6c597-bdc9-476b-b80c-a721e4c7679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:31.492671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6c597-bdc9-476b-b80c-a721e4c7679f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:31.492975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6c597-bdc9-476b-b80c-a721e4c7679f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:31.493246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6c597-bdc9-476b-b80c-a721e4c7679f None admin] PATH_INFO: `/v3/users/3fdfb9e9716340cb8a894b804b7f01cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:31.494445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6c597-bdc9-476b-b80c-a721e4c7679f None admin] RBAC: Authorizing `identity:get_user(user_id=3fdfb9e9716340cb8a894b804b7f01cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:31.495911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6c597-bdc9-476b-b80c-a721e4c7679f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:31.497970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 168/333] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:31 2022] GET /identity/v3/users/3fdfb9e9716340cb8a894b804b7f01cb => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:31.503967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5a0f1-2ba1-44cd-8b22-87ecfc3c5806 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:31.617145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5a0f1-2ba1-44cd-8b22-87ecfc3c5806 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:31.661503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680c3e3-df0d-412b-b16b-7fb20a505b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:31.662122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680c3e3-df0d-412b-b16b-7fb20a505b77 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:31.662453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680c3e3-df0d-412b-b16b-7fb20a505b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:31.662724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680c3e3-df0d-412b-b16b-7fb20a505b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:31.663632 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680c3e3-df0d-412b-b16b-7fb20a505b77 None admin] RBAC: Adding query filter params (role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, user.id=3fdfb9e9716340cb8a894b804b7f01cb, scope.system=all) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:31.663922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680c3e3-df0d-412b-b16b-7fb20a505b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:31.665386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680c3e3-df0d-412b-b16b-7fb20a505b77 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:31.683905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 166/334] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 28 17:47:31 2022] GET /identity/v3/role_assignments?user.id=3fdfb9e9716340cb8a894b804b7f01cb&scope.system=all&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:32.928112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1ed86-3ce0-455b-8dc7-cc2a13c18309 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:32.928623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1ed86-3ce0-455b-8dc7-cc2a13c18309 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:32.928623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1ed86-3ce0-455b-8dc7-cc2a13c18309 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:32.930294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 169/335] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:32.935897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d214429-948f-4be0-a271-93eb46ce8a55 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:32.936398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d214429-948f-4be0-a271-93eb46ce8a55 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:32.936552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d214429-948f-4be0-a271-93eb46ce8a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:32.957323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7d214429-948f-4be0-a271-93eb46ce8a55 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:32.958507 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7d214429-948f-4be0-a271-93eb46ce8a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:32.992769 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:33.043414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 167/336] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:33.073481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1ed86-3ce0-455b-8dc7-cc2a13c18309 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:33.146344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c58458-7ddb-4c19-befb-9e3ec83d4d0a None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.146909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c58458-7ddb-4c19-befb-9e3ec83d4d0a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.147356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c58458-7ddb-4c19-befb-9e3ec83d4d0a None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.149195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 168/337] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:33.170492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:33.172991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62212-b6d3-41fe-bd38-89e3eeb65bd0 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.173186 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62212-b6d3-41fe-bd38-89e3eeb65bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.174015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62212-b6d3-41fe-bd38-89e3eeb65bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.225313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-5db62212-b6d3-41fe-bd38-89e3eeb65bd0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:33.226504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5db62212-b6d3-41fe-bd38-89e3eeb65bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:33.301502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1ed86-3ce0-455b-8dc7-cc2a13c18309 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:33.374183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 169/338] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:33.385488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c12bb-e2b3-4805-a0af-80a8ca036cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:33.386151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c12bb-e2b3-4805-a0af-80a8ca036cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.386429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c12bb-e2b3-4805-a0af-80a8ca036cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.386705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c12bb-e2b3-4805-a0af-80a8ca036cc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.403464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c12bb-e2b3-4805-a0af-80a8ca036cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f92c12bb-e2b3-4805-a0af-80a8ca036cc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:33.419069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:33.419974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:33.420805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:33.421428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62212-b6d3-41fe-bd38-89e3eeb65bd0 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:33.421500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 170/339] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:33.429037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c12bb-e2b3-4805-a0af-80a8ca036cc8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:33.580033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:33.581294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c12bb-e2b3-4805-a0af-80a8ca036cc8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:33.590763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:33.593886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62212-b6d3-41fe-bd38-89e3eeb65bd0 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:33.627063 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b419c-ae31-404f-bcaa-db7a872404af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:33.627693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b419c-ae31-404f-bcaa-db7a872404af None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.627972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b419c-ae31-404f-bcaa-db7a872404af None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.628240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b419c-ae31-404f-bcaa-db7a872404af None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.632806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b419c-ae31-404f-bcaa-db7a872404af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:33.632806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b419c-ae31-404f-bcaa-db7a872404af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:33.632806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b419c-ae31-404f-bcaa-db7a872404af None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:33.643725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 171/340] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:33.650667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b419c-ae31-404f-bcaa-db7a872404af None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:33.677629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2147365-d332-41e7-b9ba-daf34066714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:33.678803 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2147365-d332-41e7-b9ba-daf34066714c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.679291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2147365-d332-41e7-b9ba-daf34066714c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.679766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2147365-d332-41e7-b9ba-daf34066714c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.700530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2147365-d332-41e7-b9ba-daf34066714c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-e2147365-d332-41e7-b9ba-daf34066714c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:33.707723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:33.708626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:33.709458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:33.712097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 170/341] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:33.722843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2147365-d332-41e7-b9ba-daf34066714c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:33.847284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b419c-ae31-404f-bcaa-db7a872404af None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:33.891594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d7f73-8781-4468-9115-8e5b126f6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:33.892771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d7f73-8781-4468-9115-8e5b126f6d3b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.895623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d7f73-8781-4468-9115-8e5b126f6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.895910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d7f73-8781-4468-9115-8e5b126f6d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.906346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2147365-d332-41e7-b9ba-daf34066714c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:33.942673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:33.977283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cd4a2-6817-4823-b3e0-70a524a7e2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:33.978598 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cd4a2-6817-4823-b3e0-70a524a7e2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:33.979078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cd4a2-6817-4823-b3e0-70a524a7e2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:33.979625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cd4a2-6817-4823-b3e0-70a524a7e2f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:33.980661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cd4a2-6817-4823-b3e0-70a524a7e2f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:33.981187 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cd4a2-6817-4823-b3e0-70a524a7e2f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:33.982796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cd4a2-6817-4823-b3e0-70a524a7e2f7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:33.998774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d7f73-8781-4468-9115-8e5b126f6d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:34.000615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d7f73-8781-4468-9115-8e5b126f6d3b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:34.000918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 171/342] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:34.002506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cd4a2-6817-4823-b3e0-70a524a7e2f7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:34.031470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:34.130642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 172/343] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:34.136589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d7f73-8781-4468-9115-8e5b126f6d3b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:34.203046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cd4a2-6817-4823-b3e0-70a524a7e2f7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:34.238899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:34.263950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f6b7f-f065-46b9-8bb7-fa8427cfe156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:34.264969 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f6b7f-f065-46b9-8bb7-fa8427cfe156 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.265488 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f6b7f-f065-46b9-8bb7-fa8427cfe156 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.265959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f6b7f-f065-46b9-8bb7-fa8427cfe156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:34.278672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d7f73-8781-4468-9115-8e5b126f6d3b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:34.316246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1c250-64a6-4630-aaaf-26544e4c933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:34.316929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1c250-64a6-4630-aaaf-26544e4c933d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.317212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1c250-64a6-4630-aaaf-26544e4c933d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.317486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1c250-64a6-4630-aaaf-26544e4c933d None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:34.318907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1c250-64a6-4630-aaaf-26544e4c933d None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:34.320136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1c250-64a6-4630-aaaf-26544e4c933d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:34.322167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 173/344] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:34 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:34.323334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79785fc0-6c19-4165-953c-8a5de2d657a4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.323621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79785fc0-6c19-4165-953c-8a5de2d657a4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.323891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79785fc0-6c19-4165-953c-8a5de2d657a4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:34.325262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 174/345] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:34.328462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79785fc0-6c19-4165-953c-8a5de2d657a4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:34.350624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f6b7f-f065-46b9-8bb7-fa8427cfe156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:34.352423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f6b7f-f065-46b9-8bb7-fa8427cfe156 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:34.372114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:34.440595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79785fc0-6c19-4165-953c-8a5de2d657a4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:34.465785 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 172/346] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:34.467399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac188a-1579-4753-aecb-2e86f56c3114 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.467975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac188a-1579-4753-aecb-2e86f56c3114 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.468489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac188a-1579-4753-aecb-2e86f56c3114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:34.481710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65065fc8-10c9-4400-ab73-3e8948f8353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:34.482675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65065fc8-10c9-4400-ab73-3e8948f8353c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.482675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65065fc8-10c9-4400-ab73-3e8948f8353c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.482966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65065fc8-10c9-4400-ab73-3e8948f8353c None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:34.487471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:34.490869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-0dac188a-1579-4753-aecb-2e86f56c3114 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:34.491082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65065fc8-10c9-4400-ab73-3e8948f8353c None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:34.492467 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0dac188a-1579-4753-aecb-2e86f56c3114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:34.492596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65065fc8-10c9-4400-ab73-3e8948f8353c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:34.494382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 175/347] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:34 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:34.495295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65065fc8-10c9-4400-ab73-3e8948f8353c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:34.568894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 173/348] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:34.570658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7f0d-f1ec-48de-a3c2-d7ff42c64792 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.571164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7f0d-f1ec-48de-a3c2-d7ff42c64792 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.571654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7f0d-f1ec-48de-a3c2-d7ff42c64792 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:34.573151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 174/349] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:34.576871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c7f0d-f1ec-48de-a3c2-d7ff42c64792 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:34.602798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65065fc8-10c9-4400-ab73-3e8948f8353c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:34.643987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d19e74-db5e-486c-bcd8-60c6669b345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:34.644694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d19e74-db5e-486c-bcd8-60c6669b345e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.645042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d19e74-db5e-486c-bcd8-60c6669b345e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.645318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d19e74-db5e-486c-bcd8-60c6669b345e None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:34.646565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d19e74-db5e-486c-bcd8-60c6669b345e None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:34.648079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d19e74-db5e-486c-bcd8-60c6669b345e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:34.648452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:34.650463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 176/350] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:34 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:34.651644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f929f4a-dd12-42bc-82cc-747a1ff211c4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.651927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f929f4a-dd12-42bc-82cc-747a1ff211c4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.652258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f929f4a-dd12-42bc-82cc-747a1ff211c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:34.676197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2f929f4a-dd12-42bc-82cc-747a1ff211c4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:34.679555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2f929f4a-dd12-42bc-82cc-747a1ff211c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:34.736917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c7f0d-f1ec-48de-a3c2-d7ff42c64792 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:34.767919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:34.773363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 177/351] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:34.774173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f929f4a-dd12-42bc-82cc-747a1ff211c4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:34.781273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63818615-1eaa-41d1-9ec4-38ccba5a19d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:34.782793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63818615-1eaa-41d1-9ec4-38ccba5a19d1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.783077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63818615-1eaa-41d1-9ec4-38ccba5a19d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.783657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63818615-1eaa-41d1-9ec4-38ccba5a19d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:34.784347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63818615-1eaa-41d1-9ec4-38ccba5a19d1 None admin] RBAC: Adding query filter params (group.id=7888057393bd4047a030d2f3c38127f1, role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=f98454c570304481a24ebb7a92189d26) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:34.784579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63818615-1eaa-41d1-9ec4-38ccba5a19d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:34.787127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63818615-1eaa-41d1-9ec4-38ccba5a19d1 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:34.793245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 175/352] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:34 2022] GET /identity/v3/role_assignments?group.id=7888057393bd4047a030d2f3c38127f1&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:34.794171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63818615-1eaa-41d1-9ec4-38ccba5a19d1 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:34.944000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f929f4a-dd12-42bc-82cc-747a1ff211c4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:34.964500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63818615-1eaa-41d1-9ec4-38ccba5a19d1 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:34.979069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:34.993646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512d6bd-3a74-4243-a1a0-90af925932d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:34.994754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512d6bd-3a74-4243-a1a0-90af925932d7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:34.995266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512d6bd-3a74-4243-a1a0-90af925932d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:34.995607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512d6bd-3a74-4243-a1a0-90af925932d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.007411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e704c-e284-4735-a7d2-7446b5416604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:35.008347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e704c-e284-4735-a7d2-7446b5416604 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.008826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e704c-e284-4735-a7d2-7446b5416604 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.009333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e704c-e284-4735-a7d2-7446b5416604 None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.009619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512d6bd-3a74-4243-a1a0-90af925932d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:35.011099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e704c-e284-4735-a7d2-7446b5416604 None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:35.013007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e704c-e284-4735-a7d2-7446b5416604 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:35.014947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 176/353] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:34 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:35.016074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e704c-e284-4735-a7d2-7446b5416604 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9512d6bd-3a74-4243-a1a0-90af925932d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:35.016377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:35.017536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 178/354] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:35.019209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd9bc9-ae49-44c0-a7ac-0673294a87bb None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.020211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd9bc9-ae49-44c0-a7ac-0673294a87bb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.020211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd9bc9-ae49-44c0-a7ac-0673294a87bb None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.024969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 179/355] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:35.024969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd9bc9-ae49-44c0-a7ac-0673294a87bb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:35.114033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:35.139954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e704c-e284-4735-a7d2-7446b5416604 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:35.183122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cb48a-b03a-49e4-b79c-cfee79d1107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:35.183616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd9bc9-ae49-44c0-a7ac-0673294a87bb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:35.183744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cb48a-b03a-49e4-b79c-cfee79d1107d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.184031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cb48a-b03a-49e4-b79c-cfee79d1107d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.184304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cb48a-b03a-49e4-b79c-cfee79d1107d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.199919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cb48a-b03a-49e4-b79c-cfee79d1107d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-978cb48a-b03a-49e4-b79c-cfee79d1107d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:35.208180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:35.210446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 177/356] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:35.212299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6eebe1-9860-4cc5-87a2-f7f9e78eb121 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.213304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6eebe1-9860-4cc5-87a2-f7f9e78eb121 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.213304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6eebe1-9860-4cc5-87a2-f7f9e78eb121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.231809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54771e8e-4f0b-4ac7-97b7-cc8186eccc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:35.232434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54771e8e-4f0b-4ac7-97b7-cc8186eccc7d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.232716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54771e8e-4f0b-4ac7-97b7-cc8186eccc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.233034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54771e8e-4f0b-4ac7-97b7-cc8186eccc7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.233828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54771e8e-4f0b-4ac7-97b7-cc8186eccc7d None admin] RBAC: Adding query filter params (group.id=7888057393bd4047a030d2f3c38127f1, role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=f98454c570304481a24ebb7a92189d26) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:35.234139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54771e8e-4f0b-4ac7-97b7-cc8186eccc7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:35.235695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54771e8e-4f0b-4ac7-97b7-cc8186eccc7d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:35.236472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-bc6eebe1-9860-4cc5-87a2-f7f9e78eb121 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:35.237941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bc6eebe1-9860-4cc5-87a2-f7f9e78eb121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:35.241829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 180/357] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:35 2022] GET /identity/v3/role_assignments?group.id=7888057393bd4047a030d2f3c38127f1&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:35.242637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54771e8e-4f0b-4ac7-97b7-cc8186eccc7d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:35.275553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:35.319384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 178/358] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:35.320556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6eebe1-9860-4cc5-87a2-f7f9e78eb121 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:35.433656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6eebe1-9860-4cc5-87a2-f7f9e78eb121 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:35.471534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54771e8e-4f0b-4ac7-97b7-cc8186eccc7d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:35.472003 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacbf9b-c43c-44a6-84d3-fc4e6e49abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:35.472697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacbf9b-c43c-44a6-84d3-fc4e6e49abe9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.473107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacbf9b-c43c-44a6-84d3-fc4e6e49abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.473444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacbf9b-c43c-44a6-84d3-fc4e6e49abe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.474358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacbf9b-c43c-44a6-84d3-fc4e6e49abe9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:35.474726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacbf9b-c43c-44a6-84d3-fc4e6e49abe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:35.476283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacbf9b-c43c-44a6-84d3-fc4e6e49abe9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:35.486892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 179/359] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:35.487937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacbf9b-c43c-44a6-84d3-fc4e6e49abe9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:35.511882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:35.521566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:35.547518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed0e0f-5dd4-468f-9127-e6a25d609b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:35.548062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0e0f-5dd4-468f-9127-e6a25d609b26 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.548368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0e0f-5dd4-468f-9127-e6a25d609b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.548675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0e0f-5dd4-468f-9127-e6a25d609b26 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.549418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed0e0f-5dd4-468f-9127-e6a25d609b26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:35.549781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed0e0f-5dd4-468f-9127-e6a25d609b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:35.551089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed0e0f-5dd4-468f-9127-e6a25d609b26 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:35.568763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 181/360] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:35.570348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d3b1-fb5e-4eb4-ace3-ff2f86d3a56e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.570652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d3b1-fb5e-4eb4-ace3-ff2f86d3a56e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.570911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d3b1-fb5e-4eb4-ace3-ff2f86d3a56e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.572137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 182/361] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:35.573113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d3b1-fb5e-4eb4-ace3-ff2f86d3a56e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:35.627243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacbf9b-c43c-44a6-84d3-fc4e6e49abe9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:35.675893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea9b3f-786d-41fe-b697-ead033d2ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:35.677357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea9b3f-786d-41fe-b697-ead033d2ac3b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.677847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea9b3f-786d-41fe-b697-ead033d2ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.678319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea9b3f-786d-41fe-b697-ead033d2ac3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.692697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea9b3f-786d-41fe-b697-ead033d2ac3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-ceea9b3f-786d-41fe-b697-ead033d2ac3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:35.700663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:35.701608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 17:47:35.702403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:35.705696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 180/362] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:35.706935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea9b3f-786d-41fe-b697-ead033d2ac3b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:35.711335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d3b1-fb5e-4eb4-ace3-ff2f86d3a56e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:35.763481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42a73b-a3ef-4392-9bc1-45190b213bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:35.764113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42a73b-a3ef-4392-9bc1-45190b213bfa None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.764394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42a73b-a3ef-4392-9bc1-45190b213bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.764668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42a73b-a3ef-4392-9bc1-45190b213bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:35.831213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:35.835476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:35.845054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea9b3f-786d-41fe-b697-ead033d2ac3b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:35.853411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42a73b-a3ef-4392-9bc1-45190b213bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:35.855274 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42a73b-a3ef-4392-9bc1-45190b213bfa None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:35.910738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d68ec-3021-4680-862d-2f1f398197b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:35.911613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d68ec-3021-4680-862d-2f1f398197b2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:35.912030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d68ec-3021-4680-862d-2f1f398197b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:35.912454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d68ec-3021-4680-862d-2f1f398197b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.005143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d68ec-3021-4680-862d-2f1f398197b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:36.007371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d68ec-3021-4680-862d-2f1f398197b2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:36.007918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 183/363] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:36.009339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589036-c63e-4857-b972-151d52fc0513 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:36.009623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589036-c63e-4857-b972-151d52fc0513 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:36.009895 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589036-c63e-4857-b972-151d52fc0513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.030744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4f589036-c63e-4857-b972-151d52fc0513 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:36.031888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4f589036-c63e-4857-b972-151d52fc0513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:36.110651 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 184/364] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:36.117664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589036-c63e-4857-b972-151d52fc0513 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.123875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:36.135654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 181/365] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:36.145175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d68ec-3021-4680-862d-2f1f398197b2 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.145495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:36.254078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589036-c63e-4857-b972-151d52fc0513 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:36.276181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d68ec-3021-4680-862d-2f1f398197b2 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:36.293030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4978-5655-4d9d-8034-54166d909769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:36.294057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4978-5655-4d9d-8034-54166d909769 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:36.294643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4978-5655-4d9d-8034-54166d909769 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:36.295086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4978-5655-4d9d-8034-54166d909769 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.295968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4978-5655-4d9d-8034-54166d909769 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:36.296457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4978-5655-4d9d-8034-54166d909769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:36.298389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4978-5655-4d9d-8034-54166d909769 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:36.312426 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 185/366] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:36.313584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4978-5655-4d9d-8034-54166d909769 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.316543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27dbc4-a5af-4dba-b565-bd1b6202cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:36.317285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27dbc4-a5af-4dba-b565-bd1b6202cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:36.317637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27dbc4-a5af-4dba-b565-bd1b6202cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:36.317977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27dbc4-a5af-4dba-b565-bd1b6202cbd3 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.319206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27dbc4-a5af-4dba-b565-bd1b6202cbd3 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:36.320739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27dbc4-a5af-4dba-b565-bd1b6202cbd3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:36.326983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 182/367] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:36.326983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27dbc4-a5af-4dba-b565-bd1b6202cbd3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.387444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:36.413174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:36.432813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27dbc4-a5af-4dba-b565-bd1b6202cbd3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:36.437396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4978-5655-4d9d-8034-54166d909769 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:36.469937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863ed2-eced-4e47-a44f-96b3e2040e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:36.471249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863ed2-eced-4e47-a44f-96b3e2040e45 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:36.471626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863ed2-eced-4e47-a44f-96b3e2040e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:36.471997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863ed2-eced-4e47-a44f-96b3e2040e45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.475804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f2308-ce6d-44ac-8b71-2074b4bede07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:36.476631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f2308-ce6d-44ac-8b71-2074b4bede07 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:36.477104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f2308-ce6d-44ac-8b71-2074b4bede07 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:36.477515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f2308-ce6d-44ac-8b71-2074b4bede07 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.478868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f2308-ce6d-44ac-8b71-2074b4bede07 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:36.480585 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f2308-ce6d-44ac-8b71-2074b4bede07 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:36.482867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 186/368] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:36.483955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f2308-ce6d-44ac-8b71-2074b4bede07 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.484464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00863ed2-eced-4e47-a44f-96b3e2040e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-00863ed2-eced-4e47-a44f-96b3e2040e45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:36.490474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:36.491437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 183/369] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:36.494725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863ed2-eced-4e47-a44f-96b3e2040e45 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.615137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863ed2-eced-4e47-a44f-96b3e2040e45 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:36.622135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f2308-ce6d-44ac-8b71-2074b4bede07 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:36.643074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:36.665168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8288e5b-40a2-461c-9cec-4b7c2cd3e143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:36.666307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8288e5b-40a2-461c-9cec-4b7c2cd3e143 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:36.666763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8288e5b-40a2-461c-9cec-4b7c2cd3e143 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:36.667335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8288e5b-40a2-461c-9cec-4b7c2cd3e143 None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.668744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641169d6-1479-452c-9561-49a7a78d9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:36.669502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641169d6-1479-452c-9561-49a7a78d9162 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:36.669797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8288e5b-40a2-461c-9cec-4b7c2cd3e143 None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:36.669892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641169d6-1479-452c-9561-49a7a78d9162 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:36.670217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641169d6-1479-452c-9561-49a7a78d9162 None admin] PATH_INFO: `/v3/users/0fb1151204d84b75a69079a8cb7981b8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.671523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641169d6-1479-452c-9561-49a7a78d9162 None admin] RBAC: Authorizing `identity:get_user(user_id=0fb1151204d84b75a69079a8cb7981b8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:36.672105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8288e5b-40a2-461c-9cec-4b7c2cd3e143 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:36.673105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641169d6-1479-452c-9561-49a7a78d9162 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:36.675732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 187/370] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/users/0fb1151204d84b75a69079a8cb7981b8 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:36.676039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 184/371] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:36.676660 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641169d6-1479-452c-9561-49a7a78d9162 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.676985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8288e5b-40a2-461c-9cec-4b7c2cd3e143 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.695021 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:36.804117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8288e5b-40a2-461c-9cec-4b7c2cd3e143 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:36.807621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641169d6-1479-452c-9561-49a7a78d9162 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:36.841055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51890a4-7e40-4c32-a859-9c658aa520c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:36.841685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51890a4-7e40-4c32-a859-9c658aa520c7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:36.841969 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51890a4-7e40-4c32-a859-9c658aa520c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:36.842244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51890a4-7e40-4c32-a859-9c658aa520c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.842970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51890a4-7e40-4c32-a859-9c658aa520c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:36.843279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51890a4-7e40-4c32-a859-9c658aa520c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:36.844686 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51890a4-7e40-4c32-a859-9c658aa520c7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:36.851487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bb4f2-5d64-4bf5-8417-af9830cf4e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:36.852722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bb4f2-5d64-4bf5-8417-af9830cf4e2f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:36.853049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bb4f2-5d64-4bf5-8417-af9830cf4e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:36.853330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bb4f2-5d64-4bf5-8417-af9830cf4e2f None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:36.855941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bb4f2-5d64-4bf5-8417-af9830cf4e2f None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:36.857527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bb4f2-5d64-4bf5-8417-af9830cf4e2f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:36.859412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 188/372] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:36.859979 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 185/373] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:36.861331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bb4f2-5d64-4bf5-8417-af9830cf4e2f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.866091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51890a4-7e40-4c32-a859-9c658aa520c7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:36.938719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:36.981944 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:36.998566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51890a4-7e40-4c32-a859-9c658aa520c7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:37.009136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bb4f2-5d64-4bf5-8417-af9830cf4e2f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:37.049826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e38ba-5435-4661-b3c6-7d201fdb24e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:37.051800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e38ba-5435-4661-b3c6-7d201fdb24e3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.052560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e38ba-5435-4661-b3c6-7d201fdb24e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.053062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e38ba-5435-4661-b3c6-7d201fdb24e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.054316 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e38ba-5435-4661-b3c6-7d201fdb24e3 None admin] RBAC: Adding query filter params (role.id=cfeca18af06d4545b5672877734062d7, user.id=0fb1151204d84b75a69079a8cb7981b8, scope.system=all) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:37.055238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e38ba-5435-4661-b3c6-7d201fdb24e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:37.057385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e38ba-5435-4661-b3c6-7d201fdb24e3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:37.061017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78755cf-7406-4ea1-a7fe-1e88208fa887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:37.061487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78755cf-7406-4ea1-a7fe-1e88208fa887 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.061764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78755cf-7406-4ea1-a7fe-1e88208fa887 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.062033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78755cf-7406-4ea1-a7fe-1e88208fa887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.062815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78755cf-7406-4ea1-a7fe-1e88208fa887 None admin] RBAC: Adding query filter params (group.id=7888057393bd4047a030d2f3c38127f1, role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:37.063213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78755cf-7406-4ea1-a7fe-1e88208fa887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:37.064695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78755cf-7406-4ea1-a7fe-1e88208fa887 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:37.073721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 186/375] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/role_assignments?user.id=0fb1151204d84b75a69079a8cb7981b8&scope.system=all&role.id=cfeca18af06d4545b5672877734062d7 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:37.074629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 189/375] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:36 2022] GET /identity/v3/role_assignments?group.id=7888057393bd4047a030d2f3c38127f1&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:37.075122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e38ba-5435-4661-b3c6-7d201fdb24e3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:37.075484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78755cf-7406-4ea1-a7fe-1e88208fa887 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:37.201962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e38ba-5435-4661-b3c6-7d201fdb24e3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:37.210361 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:37.244456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98252e4-e681-493e-b883-ff09be71da2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:37.245117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98252e4-e681-493e-b883-ff09be71da2b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.245399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98252e4-e681-493e-b883-ff09be71da2b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.245676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98252e4-e681-493e-b883-ff09be71da2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.246479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98252e4-e681-493e-b883-ff09be71da2b None admin] RBAC: Adding query filter params (group.id=7888057393bd4047a030d2f3c38127f1, role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:37.247229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98252e4-e681-493e-b883-ff09be71da2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:37.248924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98252e4-e681-493e-b883-ff09be71da2b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:37.256454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 187/376] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:37 2022] GET /identity/v3/role_assignments?group.id=7888057393bd4047a030d2f3c38127f1&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:37.312007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f15f-e34c-45a8-b302-335d3ff3950a None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.312335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f15f-e34c-45a8-b302-335d3ff3950a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.312564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f15f-e34c-45a8-b302-335d3ff3950a None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.315463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 188/377] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:37.317634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78755cf-7406-4ea1-a7fe-1e88208fa887 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:37.322739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995f397-745f-4c3b-a0aa-6928c361165f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.323052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995f397-745f-4c3b-a0aa-6928c361165f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.323294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995f397-745f-4c3b-a0aa-6928c361165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.359648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-d995f397-745f-4c3b-a0aa-6928c361165f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:37.361764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d995f397-745f-4c3b-a0aa-6928c361165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:37.389019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d05caa-d661-4aba-8864-74aca047f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:37.389792 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05caa-d661-4aba-8864-74aca047f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.390072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05caa-d661-4aba-8864-74aca047f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.390344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05caa-d661-4aba-8864-74aca047f6c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.427506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:37.479427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 189/378] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:37.516526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995f397-745f-4c3b-a0aa-6928c361165f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:37.543986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d05caa-d661-4aba-8864-74aca047f6c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:37.545304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d05caa-d661-4aba-8864-74aca047f6c7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:37.683293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 190/379] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:37.684571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727cc24-3ac5-493b-987a-603605e484a8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.684927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727cc24-3ac5-493b-987a-603605e484a8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.685460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727cc24-3ac5-493b-987a-603605e484a8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.686970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 191/380] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:37.691791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727cc24-3ac5-493b-987a-603605e484a8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:37.693084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:37.697444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995f397-745f-4c3b-a0aa-6928c361165f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:37.738097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb61d9-c6fe-43c3-8c8e-4815d9c8d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:37.739103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb61d9-c6fe-43c3-8c8e-4815d9c8d007 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.739602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb61d9-c6fe-43c3-8c8e-4815d9c8d007 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.740062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb61d9-c6fe-43c3-8c8e-4815d9c8d007 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.748072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:37.752922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb61d9-c6fe-43c3-8c8e-4815d9c8d007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-20fb61d9-c6fe-43c3-8c8e-4815d9c8d007 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:37.758384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:37.762688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 190/381] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:37.763456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a622-6fc3-4415-9f98-0eb8f962a82a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.764152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a622-6fc3-4415-9f98-0eb8f962a82a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.764152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a622-6fc3-4415-9f98-0eb8f962a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.784890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f214a622-6fc3-4415-9f98-0eb8f962a82a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:37.786157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f214a622-6fc3-4415-9f98-0eb8f962a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:37.813478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727cc24-3ac5-493b-987a-603605e484a8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:37.864991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 191/382] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:37.867317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214a622-6fc3-4415-9f98-0eb8f962a82a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:37.882715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49013cb-36b4-4522-8690-84859a87e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:37.883358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49013cb-36b4-4522-8690-84859a87e0ff None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:37.883637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49013cb-36b4-4522-8690-84859a87e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:37.883903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49013cb-36b4-4522-8690-84859a87e0ff None admin] PATH_INFO: `/v3/projects/a97b72a2b1b942bf9e2176dec834c175` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:37.885271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49013cb-36b4-4522-8690-84859a87e0ff None admin] RBAC: Authorizing `identity:get_project(project_id=a97b72a2b1b942bf9e2176dec834c175)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:37.886725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49013cb-36b4-4522-8690-84859a87e0ff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:37.890017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 192/383] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:37 2022] GET /identity/v3/projects/a97b72a2b1b942bf9e2176dec834c175 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:37.896963 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49013cb-36b4-4522-8690-84859a87e0ff None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:37.990583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:38.002326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214a622-6fc3-4415-9f98-0eb8f962a82a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.025422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49013cb-36b4-4522-8690-84859a87e0ff None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.048133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01136ab1-3445-46b1-9aa3-7a56206d1611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.049366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01136ab1-3445-46b1-9aa3-7a56206d1611 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.049786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01136ab1-3445-46b1-9aa3-7a56206d1611 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.050195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01136ab1-3445-46b1-9aa3-7a56206d1611 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.051459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01136ab1-3445-46b1-9aa3-7a56206d1611 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:38.051932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01136ab1-3445-46b1-9aa3-7a56206d1611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:38.053135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:38.053702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01136ab1-3445-46b1-9aa3-7a56206d1611 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:38.065355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 192/384] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:38.066577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01136ab1-3445-46b1-9aa3-7a56206d1611 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:38.078055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7a60-e1fb-4ce5-a018-2fc778956b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.078815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7a60-e1fb-4ce5-a018-2fc778956b67 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.079165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7a60-e1fb-4ce5-a018-2fc778956b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.079506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7a60-e1fb-4ce5-a018-2fc778956b67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.098374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7a60-e1fb-4ce5-a018-2fc778956b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0b4b7a60-e1fb-4ce5-a018-2fc778956b67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:38.105227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:38.106161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:38.107217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 193/385] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:38.108153 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7a60-e1fb-4ce5-a018-2fc778956b67 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:38.211711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01136ab1-3445-46b1-9aa3-7a56206d1611 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.240726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7a60-e1fb-4ce5-a018-2fc778956b67 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.250522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6aa03a-7f6e-4e91-98fe-64af4b8e4ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.252088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6aa03a-7f6e-4e91-98fe-64af4b8e4ddc None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.252550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6aa03a-7f6e-4e91-98fe-64af4b8e4ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.253026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6aa03a-7f6e-4e91-98fe-64af4b8e4ddc None admin] PATH_INFO: `/v3/groups/cdfd203bf36644dc8af2c884b4597281` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.263961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6aa03a-7f6e-4e91-98fe-64af4b8e4ddc None admin] RBAC: Authorizing `identity:get_group(group_id=cdfd203bf36644dc8af2c884b4597281)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:38.265838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6aa03a-7f6e-4e91-98fe-64af4b8e4ddc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:38.268133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 193/386] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:38 2022] GET /identity/v3/groups/cdfd203bf36644dc8af2c884b4597281 => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:38.269118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6aa03a-7f6e-4e91-98fe-64af4b8e4ddc None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:38.292972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29ef08-b2c4-4c7e-8013-38d157050942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.294173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29ef08-b2c4-4c7e-8013-38d157050942 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.295133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29ef08-b2c4-4c7e-8013-38d157050942 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.295851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29ef08-b2c4-4c7e-8013-38d157050942 None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.297665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:38.298026 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29ef08-b2c4-4c7e-8013-38d157050942 None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:38.301186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29ef08-b2c4-4c7e-8013-38d157050942 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:38.303761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 194/387] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:38 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:38.304771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29ef08-b2c4-4c7e-8013-38d157050942 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:38.367033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:38.408432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6aa03a-7f6e-4e91-98fe-64af4b8e4ddc None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.442736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29ef08-b2c4-4c7e-8013-38d157050942 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.455466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee23d22-6650-4ca4-af5b-f73ba04c7088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.456505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23d22-6650-4ca4-af5b-f73ba04c7088 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.457019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23d22-6650-4ca4-af5b-f73ba04c7088 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.457559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23d22-6650-4ca4-af5b-f73ba04c7088 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.458652 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee23d22-6650-4ca4-af5b-f73ba04c7088 None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:38.459355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee23d22-6650-4ca4-af5b-f73ba04c7088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:38.461020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee23d22-6650-4ca4-af5b-f73ba04c7088 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:38.470708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 194/388] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:38.472074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee23d22-6650-4ca4-af5b-f73ba04c7088 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:38.479829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8340857-bbc4-4254-a5ce-fa2a7ff47aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.480454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8340857-bbc4-4254-a5ce-fa2a7ff47aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.480734 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8340857-bbc4-4254-a5ce-fa2a7ff47aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.481971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8340857-bbc4-4254-a5ce-fa2a7ff47aa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.481971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8340857-bbc4-4254-a5ce-fa2a7ff47aa4 None admin] RBAC: Adding query filter params (group.id=cdfd203bf36644dc8af2c884b4597281, role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=a97b72a2b1b942bf9e2176dec834c175) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:38.482142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8340857-bbc4-4254-a5ce-fa2a7ff47aa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:38.483556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8340857-bbc4-4254-a5ce-fa2a7ff47aa4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:38.490023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 195/389] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:38 2022] GET /identity/v3/role_assignments?group.id=cdfd203bf36644dc8af2c884b4597281&scope.project.id=a97b72a2b1b942bf9e2176dec834c175&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:38.490887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8340857-bbc4-4254-a5ce-fa2a7ff47aa4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:38.566386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:38.611848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee23d22-6650-4ca4-af5b-f73ba04c7088 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.665028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8340857-bbc4-4254-a5ce-fa2a7ff47aa4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.665360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab53f43-ab5e-4b7e-855a-87dfb8942abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.666250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab53f43-ab5e-4b7e-855a-87dfb8942abe None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.666730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab53f43-ab5e-4b7e-855a-87dfb8942abe None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.667221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab53f43-ab5e-4b7e-855a-87dfb8942abe None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.669252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab53f43-ab5e-4b7e-855a-87dfb8942abe None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:38.670994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab53f43-ab5e-4b7e-855a-87dfb8942abe None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:38.673188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 195/390] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:38 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:38.673584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:38.683470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab53f43-ab5e-4b7e-855a-87dfb8942abe None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:38.721314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab132b71-677f-4e35-96e6-e5b56b2fdba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.722027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab132b71-677f-4e35-96e6-e5b56b2fdba8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.722378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab132b71-677f-4e35-96e6-e5b56b2fdba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.722665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab132b71-677f-4e35-96e6-e5b56b2fdba8 None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.724115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab132b71-677f-4e35-96e6-e5b56b2fdba8 None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:38.726267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab132b71-677f-4e35-96e6-e5b56b2fdba8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:38.728279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 196/391] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:38 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:38.734533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab132b71-677f-4e35-96e6-e5b56b2fdba8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:38.848590 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab132b71-677f-4e35-96e6-e5b56b2fdba8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.890464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e02ce0-c904-432b-b88e-d72d7240af7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.891293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e02ce0-c904-432b-b88e-d72d7240af7c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.891956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e02ce0-c904-432b-b88e-d72d7240af7c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.892763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e02ce0-c904-432b-b88e-d72d7240af7c None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.894500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e02ce0-c904-432b-b88e-d72d7240af7c None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:38.896501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e02ce0-c904-432b-b88e-d72d7240af7c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:38.898996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 197/392] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:38 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:38.905081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e02ce0-c904-432b-b88e-d72d7240af7c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:38.906328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab53f43-ab5e-4b7e-855a-87dfb8942abe None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:38.979885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8690633-74f5-45f8-a92a-3a6402113ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:38.980562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8690633-74f5-45f8-a92a-3a6402113ba6 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:38.980863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8690633-74f5-45f8-a92a-3a6402113ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:38.981145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8690633-74f5-45f8-a92a-3a6402113ba6 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26/groups/7888057393bd4047a030d2f3c38127f1/roles/5f8cf1f7cff749478558197b9f9ba38d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:38.987948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8690633-74f5-45f8-a92a-3a6402113ba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f98454c570304481a24ebb7a92189d26, group_id=7888057393bd4047a030d2f3c38127f1, role_id=5f8cf1f7cff749478558197b9f9ba38d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:38.989146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:38.989569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8690633-74f5-45f8-a92a-3a6402113ba6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:39.057006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e02ce0-c904-432b-b88e-d72d7240af7c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:39.071481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 196/393] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 28 17:47:38 2022] PUT /identity/v3/projects/f98454c570304481a24ebb7a92189d26/groups/7888057393bd4047a030d2f3c38127f1/roles/5f8cf1f7cff749478558197b9f9ba38d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:39.105674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1215e0d-7279-4cee-83ff-2b2fe532ca05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:39.106331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1215e0d-7279-4cee-83ff-2b2fe532ca05 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:39.106615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1215e0d-7279-4cee-83ff-2b2fe532ca05 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:39.106896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1215e0d-7279-4cee-83ff-2b2fe532ca05 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26/groups/7888057393bd4047a030d2f3c38127f1/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:39.109080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1215e0d-7279-4cee-83ff-2b2fe532ca05 None admin] RBAC: Authorizing `identity:create_grant(project_id=f98454c570304481a24ebb7a92189d26, group_id=7888057393bd4047a030d2f3c38127f1, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:39.110597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1215e0d-7279-4cee-83ff-2b2fe532ca05 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:39.232241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 198/394] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 28 17:47:38 2022] PUT /identity/v3/projects/f98454c570304481a24ebb7a92189d26/groups/7888057393bd4047a030d2f3c38127f1/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:39.677418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4ab99-0aa8-4c29-a286-1761bdab7e07 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:39.677830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4ab99-0aa8-4c29-a286-1761bdab7e07 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:39.678008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4ab99-0aa8-4c29-a286-1761bdab7e07 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:39.679627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 197/395] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:39.684617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d104d-d01d-4261-b0ac-2e8b9510cfc8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:39.684939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d104d-d01d-4261-b0ac-2e8b9510cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:39.685475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d104d-d01d-4261-b0ac-2e8b9510cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:39.709773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-712d104d-d01d-4261-b0ac-2e8b9510cfc8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:39.710982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-712d104d-d01d-4261-b0ac-2e8b9510cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:39.724431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934e0e-90fd-4da8-8e5e-89ee3f8adb25 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:39.725026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934e0e-90fd-4da8-8e5e-89ee3f8adb25 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:39.725521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934e0e-90fd-4da8-8e5e-89ee3f8adb25 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:39.727279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 198/396] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:39.732496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb6ae0-1d80-40d6-902d-c17d02423d38 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:39.733027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb6ae0-1d80-40d6-902d-c17d02423d38 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:39.733522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb6ae0-1d80-40d6-902d-c17d02423d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:39.747465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:39.754225 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c4fb6ae0-1d80-40d6-902d-c17d02423d38 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:39.755844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c4fb6ae0-1d80-40d6-902d-c17d02423d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:39.833488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 199/397] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:39.837489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 199/398] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:39.861607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d104d-d01d-4261-b0ac-2e8b9510cfc8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:39.873214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb6ae0-1d80-40d6-902d-c17d02423d38 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:39.917950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:40.027538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb6ae0-1d80-40d6-902d-c17d02423d38 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.056343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d104d-d01d-4261-b0ac-2e8b9510cfc8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.087864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627d99d-179e-453f-a55f-c5ee6808b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.089349 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627d99d-179e-453f-a55f-c5ee6808b987 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.090096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627d99d-179e-453f-a55f-c5ee6808b987 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.091001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627d99d-179e-453f-a55f-c5ee6808b987 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:40.100817 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:40.112151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627d99d-179e-453f-a55f-c5ee6808b987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-b627d99d-179e-453f-a55f-c5ee6808b987 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:40.120593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:40.121528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:40.122315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:40.123455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 200/399] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:40.131728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627d99d-179e-453f-a55f-c5ee6808b987 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:40.134043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acffb68-c92c-4c94-83bb-60c7c81d98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.134699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acffb68-c92c-4c94-83bb-60c7c81d98c5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.135023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acffb68-c92c-4c94-83bb-60c7c81d98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.135294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acffb68-c92c-4c94-83bb-60c7c81d98c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:40.156114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acffb68-c92c-4c94-83bb-60c7c81d98c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2acffb68-c92c-4c94-83bb-60c7c81d98c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:40.163362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:40.164358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:40.165192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:40.165831 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 200/400] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:40.172912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acffb68-c92c-4c94-83bb-60c7c81d98c5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:40.288473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627d99d-179e-453f-a55f-c5ee6808b987 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.327120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b0c10-0763-4212-a7a4-189538fe3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.327987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b0c10-0763-4212-a7a4-189538fe3160 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.328431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b0c10-0763-4212-a7a4-189538fe3160 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.328866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b0c10-0763-4212-a7a4-189538fe3160 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:40.329748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b0c10-0763-4212-a7a4-189538fe3160 None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:40.330188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b0c10-0763-4212-a7a4-189538fe3160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:40.331705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b0c10-0763-4212-a7a4-189538fe3160 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:40.339639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:40.341180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 201/401] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:40.347594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b0c10-0763-4212-a7a4-189538fe3160 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:40.356606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acffb68-c92c-4c94-83bb-60c7c81d98c5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.408749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1da31-029c-4fc4-9226-81958f2d511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.409401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1da31-029c-4fc4-9226-81958f2d511a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.409678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1da31-029c-4fc4-9226-81958f2d511a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.410009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1da31-029c-4fc4-9226-81958f2d511a None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:40.410653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1da31-029c-4fc4-9226-81958f2d511a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:40.410955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1da31-029c-4fc4-9226-81958f2d511a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:40.411881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:40.412605 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1da31-029c-4fc4-9226-81958f2d511a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 201/402] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:40.435435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1da31-029c-4fc4-9226-81958f2d511a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:40.458329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b0c10-0763-4212-a7a4-189538fe3160 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.497635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a766e94-17a6-4263-b727-2ce94030e208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.498548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a766e94-17a6-4263-b727-2ce94030e208 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.499005 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a766e94-17a6-4263-b727-2ce94030e208 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.499512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a766e94-17a6-4263-b727-2ce94030e208 None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:40.500813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a766e94-17a6-4263-b727-2ce94030e208 None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:40.502470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a766e94-17a6-4263-b727-2ce94030e208 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:40.504558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 202/403] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:40 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:40.510168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a766e94-17a6-4263-b727-2ce94030e208 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:40.562170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1da31-029c-4fc4-9226-81958f2d511a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.600671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7b1d3-cd1a-49d3-a6c3-b4f62fe1111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.601428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7b1d3-cd1a-49d3-a6c3-b4f62fe1111e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.601637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7b1d3-cd1a-49d3-a6c3-b4f62fe1111e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.601898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7b1d3-cd1a-49d3-a6c3-b4f62fe1111e None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:40.603072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7b1d3-cd1a-49d3-a6c3-b4f62fe1111e None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:40.604527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7b1d3-cd1a-49d3-a6c3-b4f62fe1111e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:40.606537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 202/404] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:40 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:40.612046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7b1d3-cd1a-49d3-a6c3-b4f62fe1111e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:40.619456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a766e94-17a6-4263-b727-2ce94030e208 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.635150 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:40.646999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:40.656270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7204e04-67c1-4170-ae87-bf766805a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.657234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7204e04-67c1-4170-ae87-bf766805a332 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.658434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7204e04-67c1-4170-ae87-bf766805a332 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.658946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7204e04-67c1-4170-ae87-bf766805a332 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:40.660382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7204e04-67c1-4170-ae87-bf766805a332 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:40.662136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7204e04-67c1-4170-ae87-bf766805a332 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:40.664416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 203/405] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:40 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:40.671293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7204e04-67c1-4170-ae87-bf766805a332 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:40.717985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7b1d3-cd1a-49d3-a6c3-b4f62fe1111e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.786779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7204e04-67c1-4170-ae87-bf766805a332 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.814235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654d98-eca1-42a4-a405-a50247fe6268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.814798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654d98-eca1-42a4-a405-a50247fe6268 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.815080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654d98-eca1-42a4-a405-a50247fe6268 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.815354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654d98-eca1-42a4-a405-a50247fe6268 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:40.816544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e654d98-eca1-42a4-a405-a50247fe6268 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:40.818035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e654d98-eca1-42a4-a405-a50247fe6268 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:40.819716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 203/406] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:40 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:40.825548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654d98-eca1-42a4-a405-a50247fe6268 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:40.827758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f202d-207f-454e-926e-daca46926487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.828438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f202d-207f-454e-926e-daca46926487 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.828713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f202d-207f-454e-926e-daca46926487 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.829007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f202d-207f-454e-926e-daca46926487 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/groups/7888057393bd4047a030d2f3c38127f1/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:40.837733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f202d-207f-454e-926e-daca46926487 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e8d56fbcdf45a684d233aebc7e8b72, group_id=7888057393bd4047a030d2f3c38127f1, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:40.839235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f202d-207f-454e-926e-daca46926487 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:40.930708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:40.945941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654d98-eca1-42a4-a405-a50247fe6268 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:40.963676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 204/407] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 28 17:47:40 2022] PUT /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/groups/7888057393bd4047a030d2f3c38127f1/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:47:40.996928 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfd567-6af9-4072-9bb8-e56aee2c2601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:40.997638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfd567-6af9-4072-9bb8-e56aee2c2601 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:40.997930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfd567-6af9-4072-9bb8-e56aee2c2601 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:40.998202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfd567-6af9-4072-9bb8-e56aee2c2601 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/groups/7888057393bd4047a030d2f3c38127f1/roles/5f8cf1f7cff749478558197b9f9ba38d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:41.002367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfd567-6af9-4072-9bb8-e56aee2c2601 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e8d56fbcdf45a684d233aebc7e8b72, group_id=7888057393bd4047a030d2f3c38127f1, role_id=5f8cf1f7cff749478558197b9f9ba38d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:41.003867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfd567-6af9-4072-9bb8-e56aee2c2601 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:41.100853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 204/408] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 28 17:47:40 2022] PUT /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72/groups/7888057393bd4047a030d2f3c38127f1/roles/5f8cf1f7cff749478558197b9f9ba38d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:47:41.231260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6b17-6241-4b94-a847-bb35e4056a4a None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:41.231806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6b17-6241-4b94-a847-bb35e4056a4a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:41.231806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6b17-6241-4b94-a847-bb35e4056a4a None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:41.233521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 205/409] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:41.239904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe0bb-f4e9-49ff-bca5-a31354adb583 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:41.240425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe0bb-f4e9-49ff-bca5-a31354adb583 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:41.240502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe0bb-f4e9-49ff-bca5-a31354adb583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:41.261438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-79ffe0bb-f4e9-49ff-bca5-a31354adb583 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:41.262668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-79ffe0bb-f4e9-49ff-bca5-a31354adb583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:41.348776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 205/410] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:41.370917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6b17-6241-4b94-a847-bb35e4056a4a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:41.444687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:41.503746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6b17-6241-4b94-a847-bb35e4056a4a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:41.538728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09425c8-2f6c-4aaa-8b72-ef980baa66e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:41.539384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09425c8-2f6c-4aaa-8b72-ef980baa66e1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:41.539877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09425c8-2f6c-4aaa-8b72-ef980baa66e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:41.540222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09425c8-2f6c-4aaa-8b72-ef980baa66e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:41.551879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09425c8-2f6c-4aaa-8b72-ef980baa66e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-c09425c8-2f6c-4aaa-8b72-ef980baa66e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:41.557830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:41.558699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:41.559486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:41.564706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 206/411] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:47:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:41.566977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffe0bb-f4e9-49ff-bca5-a31354adb583 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:41.691154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:41.712510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffe0bb-f4e9-49ff-bca5-a31354adb583 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:41.760259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762a61f-50ad-4d53-92f6-33bcf9353ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:41.760900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762a61f-50ad-4d53-92f6-33bcf9353ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:41.761179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762a61f-50ad-4d53-92f6-33bcf9353ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:41.761446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762a61f-50ad-4d53-92f6-33bcf9353ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:41.762155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762a61f-50ad-4d53-92f6-33bcf9353ca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:41.762455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762a61f-50ad-4d53-92f6-33bcf9353ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:41.763893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762a61f-50ad-4d53-92f6-33bcf9353ca4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:41.774937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 206/412] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:41.778538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09425c8-2f6c-4aaa-8b72-ef980baa66e1 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:41.899327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09425c8-2f6c-4aaa-8b72-ef980baa66e1 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:41.913243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:41.933921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa65c5-8dbf-4a43-98d6-2fdceebbfb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:41.934570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa65c5-8dbf-4a43-98d6-2fdceebbfb2c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:41.934847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa65c5-8dbf-4a43-98d6-2fdceebbfb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:41.935123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa65c5-8dbf-4a43-98d6-2fdceebbfb2c None admin] PATH_INFO: `/v3/groups/cdfd203bf36644dc8af2c884b4597281` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:41.936514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa65c5-8dbf-4a43-98d6-2fdceebbfb2c None admin] RBAC: Authorizing `identity:get_group(group_id=cdfd203bf36644dc8af2c884b4597281)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:41.937996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa65c5-8dbf-4a43-98d6-2fdceebbfb2c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:41.939939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 207/413] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:41 2022] GET /identity/v3/groups/cdfd203bf36644dc8af2c884b4597281 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:41.945503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762a61f-50ad-4d53-92f6-33bcf9353ca4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:42.022336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c997a-dd11-4c16-b8fd-ec2f47689c83 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.022521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c997a-dd11-4c16-b8fd-ec2f47689c83 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.022743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c997a-dd11-4c16-b8fd-ec2f47689c83 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.024243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 208/414] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:42.030936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b8538-5fbc-4579-a870-f0aae5645fbb None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.031501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b8538-5fbc-4579-a870-f0aae5645fbb None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.031980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b8538-5fbc-4579-a870-f0aae5645fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.072629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-075b8538-5fbc-4579-a870-f0aae5645fbb None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:42.073864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-075b8538-5fbc-4579-a870-f0aae5645fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:42.089127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762a61f-50ad-4d53-92f6-33bcf9353ca4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:42.134286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215ab00-dcfb-40ba-9041-4cfd95085351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:42.134935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215ab00-dcfb-40ba-9041-4cfd95085351 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.135213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215ab00-dcfb-40ba-9041-4cfd95085351 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.135487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215ab00-dcfb-40ba-9041-4cfd95085351 None admin] PATH_INFO: `/v3/projects/a97b72a2b1b942bf9e2176dec834c175` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.137664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215ab00-dcfb-40ba-9041-4cfd95085351 None admin] RBAC: Authorizing `identity:get_project(project_id=a97b72a2b1b942bf9e2176dec834c175)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:42.139101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215ab00-dcfb-40ba-9041-4cfd95085351 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:42.140979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 207/415] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:41 2022] GET /identity/v3/projects/a97b72a2b1b942bf9e2176dec834c175 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:42.147226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215ab00-dcfb-40ba-9041-4cfd95085351 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:42.162968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:42.215229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 209/416] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:42.215229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a80dc-f666-4e1a-830b-d6ff8772bf29 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.215229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a80dc-f666-4e1a-830b-d6ff8772bf29 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.215229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a80dc-f666-4e1a-830b-d6ff8772bf29 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.215229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 210/417] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:42.226706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd34be-d3a9-4d93-9860-3162a91c01b8 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.227103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd34be-d3a9-4d93-9860-3162a91c01b8 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.227479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd34be-d3a9-4d93-9860-3162a91c01b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.256096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-95bd34be-d3a9-4d93-9860-3162a91c01b8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:42.257959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-95bd34be-d3a9-4d93-9860-3162a91c01b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:42.290698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215ab00-dcfb-40ba-9041-4cfd95085351 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:42.332859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 211/418] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:42.333953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd34be-d3a9-4d93-9860-3162a91c01b8 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:42.338358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037f40-b4e6-4556-9d42-b79b9a8dc90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:42.339198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037f40-b4e6-4556-9d42-b79b9a8dc90b None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.340396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037f40-b4e6-4556-9d42-b79b9a8dc90b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.340675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037f40-b4e6-4556-9d42-b79b9a8dc90b None admin] PATH_INFO: `/v3/projects/a97b72a2b1b942bf9e2176dec834c175/groups/cdfd203bf36644dc8af2c884b4597281/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.347492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b037f40-b4e6-4556-9d42-b79b9a8dc90b None admin] RBAC: Authorizing `identity:create_grant(project_id=a97b72a2b1b942bf9e2176dec834c175, group_id=cdfd203bf36644dc8af2c884b4597281, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:42.348985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b037f40-b4e6-4556-9d42-b79b9a8dc90b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:42.390580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:42.447493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd34be-d3a9-4d93-9860-3162a91c01b8 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:42.495462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 208/419] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 28 17:47:42 2022] PUT /identity/v3/projects/a97b72a2b1b942bf9e2176dec834c175/groups/cdfd203bf36644dc8af2c884b4597281/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:47:42.495462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037f40-b4e6-4556-9d42-b79b9a8dc90b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:42.495709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae97ab-8cc9-475f-a375-135c76f2ce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:42.495709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae97ab-8cc9-475f-a375-135c76f2ce85 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.495709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae97ab-8cc9-475f-a375-135c76f2ce85 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.495709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae97ab-8cc9-475f-a375-135c76f2ce85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.512223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae97ab-8cc9-475f-a375-135c76f2ce85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-c6ae97ab-8cc9-475f-a375-135c76f2ce85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:42.518550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:42.519536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:42.520319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:42.523338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 212/420] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:42.529498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae97ab-8cc9-475f-a375-135c76f2ce85 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:42.621476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:42.691421 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037f40-b4e6-4556-9d42-b79b9a8dc90b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:42.729290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae97ab-8cc9-475f-a375-135c76f2ce85 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:42.731181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:42.739430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddee3d-7b7c-42c1-8846-01709550746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:42.740582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddee3d-7b7c-42c1-8846-01709550746c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.741243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddee3d-7b7c-42c1-8846-01709550746c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.746793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddee3d-7b7c-42c1-8846-01709550746c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.755283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddee3d-7b7c-42c1-8846-01709550746c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-84ddee3d-7b7c-42c1-8846-01709550746c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:42.762698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:42.763569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:42.764435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:42.770953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 209/421] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:42.771092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb363d0-3f45-45b1-8b97-3d591e9abb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:42.771092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb363d0-3f45-45b1-8b97-3d591e9abb18 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.771390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb363d0-3f45-45b1-8b97-3d591e9abb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.772486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb363d0-3f45-45b1-8b97-3d591e9abb18 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.772486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb363d0-3f45-45b1-8b97-3d591e9abb18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:42.772643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb363d0-3f45-45b1-8b97-3d591e9abb18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:42.774123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb363d0-3f45-45b1-8b97-3d591e9abb18 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:42.775006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddee3d-7b7c-42c1-8846-01709550746c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:42.788827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 213/422] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:42.792009 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb363d0-3f45-45b1-8b97-3d591e9abb18 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:42.932397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddee3d-7b7c-42c1-8846-01709550746c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:42.959086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb363d0-3f45-45b1-8b97-3d591e9abb18 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:42.963348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:42.980697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d0160-d6a9-4c0a-a562-c304e1e8f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:42.981572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d0160-d6a9-4c0a-a562-c304e1e8f6dc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.981750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d0160-d6a9-4c0a-a562-c304e1e8f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.981956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d0160-d6a9-4c0a-a562-c304e1e8f6dc None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:42.982793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d0160-d6a9-4c0a-a562-c304e1e8f6dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:42.983203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d0160-d6a9-4c0a-a562-c304e1e8f6dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:42.984589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d0160-d6a9-4c0a-a562-c304e1e8f6dc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:42.994989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303fb36-7ff5-449f-9238-800443c4982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:42.995613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303fb36-7ff5-449f-9238-800443c4982f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:42.995894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303fb36-7ff5-449f-9238-800443c4982f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:42.996170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303fb36-7ff5-449f-9238-800443c4982f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.005483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 210/423] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:43.011315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d0160-d6a9-4c0a-a562-c304e1e8f6dc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:43.030927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:43.071149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303fb36-7ff5-449f-9238-800443c4982f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:43.072807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303fb36-7ff5-449f-9238-800443c4982f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:43.181199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 214/424] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:43.192737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303fb36-7ff5-449f-9238-800443c4982f None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:43.207007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d0160-d6a9-4c0a-a562-c304e1e8f6dc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:43.246439 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6ffa5-8c5c-49f6-b6ef-2091006d36c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:43.247064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6ffa5-8c5c-49f6-b6ef-2091006d36c0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.247344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6ffa5-8c5c-49f6-b6ef-2091006d36c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.248284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6ffa5-8c5c-49f6-b6ef-2091006d36c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.322750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:43.357034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303fb36-7ff5-449f-9238-800443c4982f None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:43.369119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:43.400391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6ffa5-8c5c-49f6-b6ef-2091006d36c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:43.402048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6ffa5-8c5c-49f6-b6ef-2091006d36c0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:43.418477 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52325ba1-9431-4d35-8b85-51534fadb5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:43.419300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52325ba1-9431-4d35-8b85-51534fadb5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.419585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52325ba1-9431-4d35-8b85-51534fadb5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.419857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52325ba1-9431-4d35-8b85-51534fadb5f2 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.423700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52325ba1-9431-4d35-8b85-51534fadb5f2 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:43.425781 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52325ba1-9431-4d35-8b85-51534fadb5f2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:43.428414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 215/425] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:43 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:43.429730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3645ef-a626-4df9-98c8-2cbe13eff71f None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.430020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3645ef-a626-4df9-98c8-2cbe13eff71f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.430298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3645ef-a626-4df9-98c8-2cbe13eff71f None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.436649 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 216/426] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:43.436649 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3645ef-a626-4df9-98c8-2cbe13eff71f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:43.528349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 211/427] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:43.529766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbebfc3-e9a5-43a3-b169-d1ec66eb742b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.530114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbebfc3-e9a5-43a3-b169-d1ec66eb742b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.530401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbebfc3-e9a5-43a3-b169-d1ec66eb742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.543747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3645ef-a626-4df9-98c8-2cbe13eff71f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:43.549704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5fbebfc3-e9a5-43a3-b169-d1ec66eb742b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:43.550889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5fbebfc3-e9a5-43a3-b169-d1ec66eb742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:43.655553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:43.660503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894212af-1dd0-4298-a42b-5f70d13c15b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:43.661163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894212af-1dd0-4298-a42b-5f70d13c15b4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.661445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894212af-1dd0-4298-a42b-5f70d13c15b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.667169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894212af-1dd0-4298-a42b-5f70d13c15b4 None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.667169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894212af-1dd0-4298-a42b-5f70d13c15b4 None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:43.667169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894212af-1dd0-4298-a42b-5f70d13c15b4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:43.670800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 217/428] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:43 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:43.672014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5422fd6-ba8a-422c-9838-309af0d8916e None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.672297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5422fd6-ba8a-422c-9838-309af0d8916e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.672600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5422fd6-ba8a-422c-9838-309af0d8916e None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.674337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 218/429] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:43.677631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5422fd6-ba8a-422c-9838-309af0d8916e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:43.699588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 212/430] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:43.700842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbebfc3-e9a5-43a3-b169-d1ec66eb742b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:43.726105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:43.790150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5422fd6-ba8a-422c-9838-309af0d8916e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:43.811181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbebfc3-e9a5-43a3-b169-d1ec66eb742b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:43.828606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee390f-ed9d-4a11-b7ef-39840e116da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:43.829298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee390f-ed9d-4a11-b7ef-39840e116da5 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.829610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee390f-ed9d-4a11-b7ef-39840e116da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.829884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee390f-ed9d-4a11-b7ef-39840e116da5 None admin] PATH_INFO: `/v3/projects/f98454c570304481a24ebb7a92189d26` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.831044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee390f-ed9d-4a11-b7ef-39840e116da5 None admin] RBAC: Authorizing `identity:get_project(project_id=f98454c570304481a24ebb7a92189d26)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:43.832485 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee390f-ed9d-4a11-b7ef-39840e116da5 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:43.834177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 219/431] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:43 2022] GET /identity/v3/projects/f98454c570304481a24ebb7a92189d26 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:43.838739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594f334-e63a-42ea-b9b0-955e50d36bfa None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.838739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594f334-e63a-42ea-b9b0-955e50d36bfa None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.838739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594f334-e63a-42ea-b9b0-955e50d36bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.850624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1696fa-5404-47b3-ac6a-acb05806e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:43.851356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1696fa-5404-47b3-ac6a-acb05806e0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:43.851638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1696fa-5404-47b3-ac6a-acb05806e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:43.851911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1696fa-5404-47b3-ac6a-acb05806e0e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:43.852707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1696fa-5404-47b3-ac6a-acb05806e0e1 None admin] RBAC: Adding query filter params (group.id=7888057393bd4047a030d2f3c38127f1, role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=f98454c570304481a24ebb7a92189d26) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:43.853046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1696fa-5404-47b3-ac6a-acb05806e0e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:43.854475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1696fa-5404-47b3-ac6a-acb05806e0e1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:43.857642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b594f334-e63a-42ea-b9b0-955e50d36bfa None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:43.859297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b594f334-e63a-42ea-b9b0-955e50d36bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:43.860428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 213/432] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:43 2022] GET /identity/v3/role_assignments?group.id=7888057393bd4047a030d2f3c38127f1&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:43.861365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1696fa-5404-47b3-ac6a-acb05806e0e1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:43.952970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:43.964820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 220/433] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:43.964820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594f334-e63a-42ea-b9b0-955e50d36bfa None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:43.972573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:44.008030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1696fa-5404-47b3-ac6a-acb05806e0e1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:44.045607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a843-1f0d-4026-bdb6-84ccb99326aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:44.046420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a843-1f0d-4026-bdb6-84ccb99326aa None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.046777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a843-1f0d-4026-bdb6-84ccb99326aa None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.047117 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a843-1f0d-4026-bdb6-84ccb99326aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.064664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9a843-1f0d-4026-bdb6-84ccb99326aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-eea9a843-1f0d-4026-bdb6-84ccb99326aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:44.073051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:44.073970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 214/434] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:44.074756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a843-1f0d-4026-bdb6-84ccb99326aa None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:44.102355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594f334-e63a-42ea-b9b0-955e50d36bfa None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:44.139281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3171a-7515-4f5c-8c75-d793f8aaee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:44.139924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3171a-7515-4f5c-8c75-d793f8aaee76 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.140206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3171a-7515-4f5c-8c75-d793f8aaee76 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.140476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3171a-7515-4f5c-8c75-d793f8aaee76 None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.141667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3171a-7515-4f5c-8c75-d793f8aaee76 None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:44.143637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3171a-7515-4f5c-8c75-d793f8aaee76 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:44.149298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 221/435] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:43 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:44.149298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3171a-7515-4f5c-8c75-d793f8aaee76 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:44.189338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a843-1f0d-4026-bdb6-84ccb99326aa None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:44.220176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:44.226025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44285-f43f-4ede-bccc-ae926a49d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:44.232655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44285-f43f-4ede-bccc-ae926a49d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.232655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44285-f43f-4ede-bccc-ae926a49d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.232655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44285-f43f-4ede-bccc-ae926a49d5f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.239010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe44285-f43f-4ede-bccc-ae926a49d5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-abe44285-f43f-4ede-bccc-ae926a49d5f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:44.244444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:44.250496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 215/436] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:44.251475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44285-f43f-4ede-bccc-ae926a49d5f1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:44.252182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:44.263224 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3171a-7515-4f5c-8c75-d793f8aaee76 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:44.299970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b2d2f-027c-4bad-9f17-4c6bb27e316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:44.300586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b2d2f-027c-4bad-9f17-4c6bb27e316c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.300896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b2d2f-027c-4bad-9f17-4c6bb27e316c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.301170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b2d2f-027c-4bad-9f17-4c6bb27e316c None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.301915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b2d2f-027c-4bad-9f17-4c6bb27e316c None admin] RBAC: Adding query filter params (name=member) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:44.302194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b2d2f-027c-4bad-9f17-4c6bb27e316c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:44.303561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b2d2f-027c-4bad-9f17-4c6bb27e316c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:44.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 222/437] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:47:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:44.313704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b2d2f-027c-4bad-9f17-4c6bb27e316c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:44.358522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44285-f43f-4ede-bccc-ae926a49d5f1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:44.394176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908907d-8be2-427f-bbe9-4182d426b34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:44.394840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908907d-8be2-427f-bbe9-4182d426b34e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.395072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908907d-8be2-427f-bbe9-4182d426b34e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.395320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908907d-8be2-427f-bbe9-4182d426b34e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.396112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908907d-8be2-427f-bbe9-4182d426b34e None admin] RBAC: Adding query filter params (group.id=7888057393bd4047a030d2f3c38127f1, role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=f98454c570304481a24ebb7a92189d26) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:44.396420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908907d-8be2-427f-bbe9-4182d426b34e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:44.397892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908907d-8be2-427f-bbe9-4182d426b34e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:44.403625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 216/438] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:44 2022] GET /identity/v3/role_assignments?group.id=7888057393bd4047a030d2f3c38127f1&scope.project.id=f98454c570304481a24ebb7a92189d26&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:44.404410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908907d-8be2-427f-bbe9-4182d426b34e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:44.442160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b2d2f-027c-4bad-9f17-4c6bb27e316c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:44.477883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:44.487972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22ce72-8cda-46d7-a2c0-b15c1cb5b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:44.489084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22ce72-8cda-46d7-a2c0-b15c1cb5b549 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.489509 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22ce72-8cda-46d7-a2c0-b15c1cb5b549 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.489987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22ce72-8cda-46d7-a2c0-b15c1cb5b549 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.494864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22ce72-8cda-46d7-a2c0-b15c1cb5b549 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:44.494864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22ce72-8cda-46d7-a2c0-b15c1cb5b549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:44.494864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22ce72-8cda-46d7-a2c0-b15c1cb5b549 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:44.504356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:44.508171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 223/439] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:44.509870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22ce72-8cda-46d7-a2c0-b15c1cb5b549 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:44.552056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908907d-8be2-427f-bbe9-4182d426b34e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:44.602157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5c75b-2bd4-4341-b722-8b2d67e53494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:44.602157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5c75b-2bd4-4341-b722-8b2d67e53494 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.602417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5c75b-2bd4-4341-b722-8b2d67e53494 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.602926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5c75b-2bd4-4341-b722-8b2d67e53494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.634060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22ce72-8cda-46d7-a2c0-b15c1cb5b549 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:44.681134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea27da-ed20-43e4-96c0-2a6335943a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:44.681764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea27da-ed20-43e4-96c0-2a6335943a7d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.682043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea27da-ed20-43e4-96c0-2a6335943a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.682312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea27da-ed20-43e4-96c0-2a6335943a7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.697487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5c75b-2bd4-4341-b722-8b2d67e53494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:44.699313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5c75b-2bd4-4341-b722-8b2d67e53494 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:44.768204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:44.777928 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:44.787623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea27da-ed20-43e4-96c0-2a6335943a7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:44.789807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea27da-ed20-43e4-96c0-2a6335943a7d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:44.830255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 217/440] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:44.831971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596970a-dd66-41be-b7ad-fcabba74cf92 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.832451 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596970a-dd66-41be-b7ad-fcabba74cf92 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.832968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596970a-dd66-41be-b7ad-fcabba74cf92 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.834406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 218/441] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:44.835735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596970a-dd66-41be-b7ad-fcabba74cf92 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:44.918679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 224/442] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:44.919934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35304dc3-87cf-49a7-9afc-d6cb56e2bdac None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:44.920223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35304dc3-87cf-49a7-9afc-d6cb56e2bdac None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:44.920501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35304dc3-87cf-49a7-9afc-d6cb56e2bdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:44.941853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-35304dc3-87cf-49a7-9afc-d6cb56e2bdac None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:44.943070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-35304dc3-87cf-49a7-9afc-d6cb56e2bdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:44.961471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596970a-dd66-41be-b7ad-fcabba74cf92 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:45.000676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d11a86-56f7-4b78-91fc-ca8fe03cb667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:45.001454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d11a86-56f7-4b78-91fc-ca8fe03cb667 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:45.002354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d11a86-56f7-4b78-91fc-ca8fe03cb667 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:45.002625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d11a86-56f7-4b78-91fc-ca8fe03cb667 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:45.004325 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d11a86-56f7-4b78-91fc-ca8fe03cb667 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:45.005251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d11a86-56f7-4b78-91fc-ca8fe03cb667 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:45.006889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 219/443] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:44 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:45.007647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d11a86-56f7-4b78-91fc-ca8fe03cb667 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:45.024116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 225/444] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:45.024916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35304dc3-87cf-49a7-9afc-d6cb56e2bdac None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:45.047291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:45.048926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:45.112764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d11a86-56f7-4b78-91fc-ca8fe03cb667 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:45.133144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35304dc3-87cf-49a7-9afc-d6cb56e2bdac None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:45.153815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1749c3-69e2-4cb8-8f60-8d4dd183e390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:45.154454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1749c3-69e2-4cb8-8f60-8d4dd183e390 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:45.154734 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1749c3-69e2-4cb8-8f60-8d4dd183e390 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:45.155009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1749c3-69e2-4cb8-8f60-8d4dd183e390 None admin] PATH_INFO: `/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:45.156152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1749c3-69e2-4cb8-8f60-8d4dd183e390 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e8d56fbcdf45a684d233aebc7e8b72)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:45.158190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1749c3-69e2-4cb8-8f60-8d4dd183e390 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:45.164716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 220/445] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:45 2022] GET /identity/v3/projects/a2e8d56fbcdf45a684d233aebc7e8b72 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:45.164716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1749c3-69e2-4cb8-8f60-8d4dd183e390 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:45.175951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d01220-252b-44d3-bf87-f20227029c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:45.176605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d01220-252b-44d3-bf87-f20227029c52 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:45.176924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d01220-252b-44d3-bf87-f20227029c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:45.177201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d01220-252b-44d3-bf87-f20227029c52 None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:45.178456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d01220-252b-44d3-bf87-f20227029c52 None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:45.179904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d01220-252b-44d3-bf87-f20227029c52 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:45.181546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 226/446] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:45 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:45.182300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d01220-252b-44d3-bf87-f20227029c52 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:45.269934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:45.270138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1749c3-69e2-4cb8-8f60-8d4dd183e390 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:45.272353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:45.281977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d01220-252b-44d3-bf87-f20227029c52 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:45.303290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcd51c-2a98-497c-9d86-b09aaded215b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:45.303922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcd51c-2a98-497c-9d86-b09aaded215b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:45.304205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcd51c-2a98-497c-9d86-b09aaded215b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:45.304474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcd51c-2a98-497c-9d86-b09aaded215b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:45.315455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcd51c-2a98-497c-9d86-b09aaded215b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-eddcd51c-2a98-497c-9d86-b09aaded215b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:45.319473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:45.320366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:47:45.321215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:45.322360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90f71b-1cc3-4260-b249-e5ed977aaca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:45.322478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 221/447] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:47:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:45.322567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f71b-1cc3-4260-b249-e5ed977aaca6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:45.322567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f71b-1cc3-4260-b249-e5ed977aaca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:45.322567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f71b-1cc3-4260-b249-e5ed977aaca6 None admin] PATH_INFO: `/v3/groups/7888057393bd4047a030d2f3c38127f1` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:45.322773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcd51c-2a98-497c-9d86-b09aaded215b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:45.325838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90f71b-1cc3-4260-b249-e5ed977aaca6 None admin] RBAC: Authorizing `identity:get_group(group_id=7888057393bd4047a030d2f3c38127f1)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:45.327335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90f71b-1cc3-4260-b249-e5ed977aaca6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:45.328972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 227/448] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:45 2022] GET /identity/v3/groups/7888057393bd4047a030d2f3c38127f1 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:45.329753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90f71b-1cc3-4260-b249-e5ed977aaca6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:45.422305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcd51c-2a98-497c-9d86-b09aaded215b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:45.428714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90f71b-1cc3-4260-b249-e5ed977aaca6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:45.456302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bed25-4ed4-4fec-a66c-40e6a925cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:45.456950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bed25-4ed4-4fec-a66c-40e6a925cf1f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:45.457225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bed25-4ed4-4fec-a66c-40e6a925cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:45.457493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bed25-4ed4-4fec-a66c-40e6a925cf1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:45.458280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bed25-4ed4-4fec-a66c-40e6a925cf1f None admin] RBAC: Adding query filter params (group.id=7888057393bd4047a030d2f3c38127f1, role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:45.458586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bed25-4ed4-4fec-a66c-40e6a925cf1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:45.460029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bed25-4ed4-4fec-a66c-40e6a925cf1f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:45.465826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 222/449] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:45 2022] GET /identity/v3/role_assignments?group.id=7888057393bd4047a030d2f3c38127f1&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:45.466595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bed25-4ed4-4fec-a66c-40e6a925cf1f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:45.487708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befe3d6-a050-40b7-9970-4721d0455bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:45.489133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befe3d6-a050-40b7-9970-4721d0455bfc None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:45.489404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befe3d6-a050-40b7-9970-4721d0455bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:45.489667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befe3d6-a050-40b7-9970-4721d0455bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:45.490421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befe3d6-a050-40b7-9970-4721d0455bfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:45.490722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befe3d6-a050-40b7-9970-4721d0455bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:45.492161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befe3d6-a050-40b7-9970-4721d0455bfc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:45.508440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 228/450] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:45.508631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:45.509706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befe3d6-a050-40b7-9970-4721d0455bfc None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:45.530870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:45.592551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bed25-4ed4-4fec-a66c-40e6a925cf1f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:45.627633 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a5798-5a44-44be-a8fa-5abab4ad4ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:45.628586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a5798-5a44-44be-a8fa-5abab4ad4ffc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:45.629075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a5798-5a44-44be-a8fa-5abab4ad4ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:45.629180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befe3d6-a050-40b7-9970-4721d0455bfc None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:45.629650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a5798-5a44-44be-a8fa-5abab4ad4ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:45.630450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a5798-5a44-44be-a8fa-5abab4ad4ffc None admin] RBAC: Adding query filter params (group.id=7888057393bd4047a030d2f3c38127f1, role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:45.630764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a5798-5a44-44be-a8fa-5abab4ad4ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:45.632204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a5798-5a44-44be-a8fa-5abab4ad4ffc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:45.638492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 223/451] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:45 2022] GET /identity/v3/role_assignments?group.id=7888057393bd4047a030d2f3c38127f1&scope.project.id=a2e8d56fbcdf45a684d233aebc7e8b72&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:45.669028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba992787-e738-45b4-86f8-44b923579fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:45.669672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba992787-e738-45b4-86f8-44b923579fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:45.669954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba992787-e738-45b4-86f8-44b923579fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:45.670231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba992787-e738-45b4-86f8-44b923579fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:45.754891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba992787-e738-45b4-86f8-44b923579fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:45.756379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba992787-e738-45b4-86f8-44b923579fd2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:45.778035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:45.862976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 229/452] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:47:45.868519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a5798-5a44-44be-a8fa-5abab4ad4ffc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:45.964023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:45.972384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a5798-5a44-44be-a8fa-5abab4ad4ffc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:46.008028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335c101-ec4b-4391-9cb6-3f9103d964be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:46.008666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335c101-ec4b-4391-9cb6-3f9103d964be None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:46.009041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335c101-ec4b-4391-9cb6-3f9103d964be None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:46.009316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335c101-ec4b-4391-9cb6-3f9103d964be None admin] PATH_INFO: `/v3/projects/a97b72a2b1b942bf9e2176dec834c175` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:46.010466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335c101-ec4b-4391-9cb6-3f9103d964be None admin] RBAC: Authorizing `identity:get_project(project_id=a97b72a2b1b942bf9e2176dec834c175)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:46.011914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335c101-ec4b-4391-9cb6-3f9103d964be None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:46.013594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 224/453] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:47:45 2022] GET /identity/v3/projects/a97b72a2b1b942bf9e2176dec834c175 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:46.019300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba992787-e738-45b4-86f8-44b923579fd2 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:46.117293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba992787-e738-45b4-86f8-44b923579fd2 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:46.134229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:46.150132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73cbb0-993c-4802-89e0-774ebb238de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:46.150760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73cbb0-993c-4802-89e0-774ebb238de3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:46.151041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73cbb0-993c-4802-89e0-774ebb238de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:46.151317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73cbb0-993c-4802-89e0-774ebb238de3 None admin] PATH_INFO: `/v3/groups/cdfd203bf36644dc8af2c884b4597281` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:46.152450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73cbb0-993c-4802-89e0-774ebb238de3 None admin] RBAC: Authorizing `identity:get_group(group_id=cdfd203bf36644dc8af2c884b4597281)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:46.153925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73cbb0-993c-4802-89e0-774ebb238de3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:46.155582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 230/454] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 28 17:47:46 2022] GET /identity/v3/groups/cdfd203bf36644dc8af2c884b4597281 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:46.161971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335c101-ec4b-4391-9cb6-3f9103d964be None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:46.258250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335c101-ec4b-4391-9cb6-3f9103d964be None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:46.290562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ae71-0a05-4067-acb3-d10e148c7847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:46.291246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ae71-0a05-4067-acb3-d10e148c7847 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:46.291527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ae71-0a05-4067-acb3-d10e148c7847 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:46.291952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ae71-0a05-4067-acb3-d10e148c7847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:46.292861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ae71-0a05-4067-acb3-d10e148c7847 None admin] RBAC: Adding query filter params (group.id=cdfd203bf36644dc8af2c884b4597281, role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=a97b72a2b1b942bf9e2176dec834c175) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:46.293175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ae71-0a05-4067-acb3-d10e148c7847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:46.294754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ae71-0a05-4067-acb3-d10e148c7847 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:46.300916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 225/455] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 28 17:47:46 2022] GET /identity/v3/role_assignments?group.id=cdfd203bf36644dc8af2c884b4597281&scope.project.id=a97b72a2b1b942bf9e2176dec834c175&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:48.847553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733fb9-45ec-46b9-9a80-1ea3270c4ffe None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:48.848072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733fb9-45ec-46b9-9a80-1ea3270c4ffe None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:48.848147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733fb9-45ec-46b9-9a80-1ea3270c4ffe None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:48.849726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 231/456] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:48.855308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ecac0-3978-4451-893f-709c34a770b5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:48.855755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ecac0-3978-4451-893f-709c34a770b5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:48.855856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ecac0-3978-4451-893f-709c34a770b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:48.881756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8f9ecac0-3978-4451-893f-709c34a770b5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:48.882964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8f9ecac0-3978-4451-893f-709c34a770b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:48.907388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:48.954337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd92ef-71ef-454a-b025-09430383e9ec None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:48.955146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd92ef-71ef-454a-b025-09430383e9ec None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:48.955405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd92ef-71ef-454a-b025-09430383e9ec None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:48.956892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 232/457] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:48.961628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3069b7-e4fd-4133-bd8f-6d833887b634 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:48.961909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3069b7-e4fd-4133-bd8f-6d833887b634 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:48.962180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3069b7-e4fd-4133-bd8f-6d833887b634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:48.981205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-eb3069b7-e4fd-4133-bd8f-6d833887b634 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:48.982376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-eb3069b7-e4fd-4133-bd8f-6d833887b634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:48.989162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 226/458] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:49.015445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ecac0-3978-4451-893f-709c34a770b5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:49.125229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 233/459] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:49.179825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233bfb1-8381-4cd7-9ea8-27c92d6ade34 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.180362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233bfb1-8381-4cd7-9ea8-27c92d6ade34 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.180863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233bfb1-8381-4cd7-9ea8-27c92d6ade34 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.182025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ecac0-3978-4451-893f-709c34a770b5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:49.182701 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 234/460] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:49.183612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233bfb1-8381-4cd7-9ea8-27c92d6ade34 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:49.222053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4a78-2f00-4e06-8300-7b7952ae0c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:49.222984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4a78-2f00-4e06-8300-7b7952ae0c94 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.223260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4a78-2f00-4e06-8300-7b7952ae0c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.223531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4a78-2f00-4e06-8300-7b7952ae0c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.233955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b4a78-2f00-4e06-8300-7b7952ae0c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:49.235388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b4a78-2f00-4e06-8300-7b7952ae0c94 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4b1b4a78-2f00-4e06-8300-7b7952ae0c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:49.251637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:49.252536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:49.253413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:49.253413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:49.253413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:49.253413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:49.253413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 227/461] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:49.254345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821608f-e8ed-4238-8a15-1442b0f3d119 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.254345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821608f-e8ed-4238-8a15-1442b0f3d119 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.254497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821608f-e8ed-4238-8a15-1442b0f3d119 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.255856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 228/462] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:49.258178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773fb1-5838-4860-9bad-4defc2632889 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.258662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773fb1-5838-4860-9bad-4defc2632889 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.259122 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773fb1-5838-4860-9bad-4defc2632889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.276362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:49.283683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-99773fb1-5838-4860-9bad-4defc2632889 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:49.284914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-99773fb1-5838-4860-9bad-4defc2632889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:49.300060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233bfb1-8381-4cd7-9ea8-27c92d6ade34 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:49.319612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:49.336910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4580d8-9ade-47fd-9729-741589a23152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:49.337547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4580d8-9ade-47fd-9729-741589a23152 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.337826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4580d8-9ade-47fd-9729-741589a23152 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.338097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4580d8-9ade-47fd-9729-741589a23152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.348631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4580d8-9ade-47fd-9729-741589a23152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:49.350131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4580d8-9ade-47fd-9729-741589a23152 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:49.357368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 229/463] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:49.358849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16086ce3-3261-42a7-bf8a-19a340c98044 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.359200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16086ce3-3261-42a7-bf8a-19a340c98044 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.359537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16086ce3-3261-42a7-bf8a-19a340c98044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-8f4580d8-9ade-47fd-9729-741589a23152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:49.373773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:49.374676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:49.375579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:49.375579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:49.375579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:49.375579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:49.377847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 235/464] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:49.378888 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4580d8-9ade-47fd-9729-741589a23152 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:49.385192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-16086ce3-3261-42a7-bf8a-19a340c98044 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:49.386378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-16086ce3-3261-42a7-bf8a-19a340c98044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:49.458228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 230/465] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:49.459347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16086ce3-3261-42a7-bf8a-19a340c98044 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:49.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4580d8-9ade-47fd-9729-741589a23152 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:49.531482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:49.543875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b670c-ca9f-4e93-a0ca-0270693ae50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:49.544493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b670c-ca9f-4e93-a0ca-0270693ae50e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.544822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b670c-ca9f-4e93-a0ca-0270693ae50e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.545068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b670c-ca9f-4e93-a0ca-0270693ae50e None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.546495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b670c-ca9f-4e93-a0ca-0270693ae50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:49.546495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b670c-ca9f-4e93-a0ca-0270693ae50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:49.547546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b670c-ca9f-4e93-a0ca-0270693ae50e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:49.565636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16086ce3-3261-42a7-bf8a-19a340c98044 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:49.565853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 236/466] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:49.566659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b670c-ca9f-4e93-a0ca-0270693ae50e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:49.600216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:49.607379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac73097-94c2-4069-b05e-f4327758cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:49.608389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac73097-94c2-4069-b05e-f4327758cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.608637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac73097-94c2-4069-b05e-f4327758cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.608988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac73097-94c2-4069-b05e-f4327758cbc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.619314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac73097-94c2-4069-b05e-f4327758cbc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:49.620752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac73097-94c2-4069-b05e-f4327758cbc9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-cac73097-94c2-4069-b05e-f4327758cbc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:49.635344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:49.636207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:49.637086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:49.637086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:49.637086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:49.637086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:49.637086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 231/467] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:49.637761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac73097-94c2-4069-b05e-f4327758cbc9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:49.675572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b670c-ca9f-4e93-a0ca-0270693ae50e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:49.712032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fc48-a651-4bef-af0b-1e9d09adf3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:49.712650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fc48-a651-4bef-af0b-1e9d09adf3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.713124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fc48-a651-4bef-af0b-1e9d09adf3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.713402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fc48-a651-4bef-af0b-1e9d09adf3c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.714859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667fc48-a651-4bef-af0b-1e9d09adf3c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:49.715164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667fc48-a651-4bef-af0b-1e9d09adf3c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:49.716536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667fc48-a651-4bef-af0b-1e9d09adf3c4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:49.732973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 237/468] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:49.733762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fc48-a651-4bef-af0b-1e9d09adf3c4 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:49.749078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac73097-94c2-4069-b05e-f4327758cbc9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:49.770948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:49.793092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b11ec8-4e19-4441-a9be-808c88b3a44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:49.793740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b11ec8-4e19-4441-a9be-808c88b3a44a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.794018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b11ec8-4e19-4441-a9be-808c88b3a44a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.794289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b11ec8-4e19-4441-a9be-808c88b3a44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.805410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b11ec8-4e19-4441-a9be-808c88b3a44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:49.806966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b11ec8-4e19-4441-a9be-808c88b3a44a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-19b11ec8-4e19-4441-a9be-808c88b3a44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:49.822453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:49.823468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:49.824430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:49.824430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:49.824430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:49.824430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:49.824430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 232/469] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:49.824803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b11ec8-4e19-4441-a9be-808c88b3a44a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:49.843647 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:49.856572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fc48-a651-4bef-af0b-1e9d09adf3c4 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:49.893892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ed03-400d-4296-8332-37e9c6b1b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:49.894700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ed03-400d-4296-8332-37e9c6b1b88b None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.894990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ed03-400d-4296-8332-37e9c6b1b88b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.895245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ed03-400d-4296-8332-37e9c6b1b88b None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.895914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0ed03-400d-4296-8332-37e9c6b1b88b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:49.898007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0ed03-400d-4296-8332-37e9c6b1b88b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:49.932336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b11ec8-4e19-4441-a9be-808c88b3a44a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:49.966327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44437-d29a-4c3c-8bdf-5bc1bfad1924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:49.966938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44437-d29a-4c3c-8bdf-5bc1bfad1924 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:49.967213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44437-d29a-4c3c-8bdf-5bc1bfad1924 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:49.967484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44437-d29a-4c3c-8bdf-5bc1bfad1924 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:49.968166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c44437-d29a-4c3c-8bdf-5bc1bfad1924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:49.968463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c44437-d29a-4c3c-8bdf-5bc1bfad1924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:49.969847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c44437-d29a-4c3c-8bdf-5bc1bfad1924 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:49.981995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 233/470] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:49.982749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44437-d29a-4c3c-8bdf-5bc1bfad1924 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:50.011691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:50.030941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 238/471] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:49 2022] POST /identity/v3/users => generated 246 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:50.041901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ed03-400d-4296-8332-37e9c6b1b88b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:50.091488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44437-d29a-4c3c-8bdf-5bc1bfad1924 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:50.135358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b8a1b-80b2-4b5e-8e51-7a8ab5425ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:50.136402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b8a1b-80b2-4b5e-8e51-7a8ab5425ec1 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:50.136514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b8a1b-80b2-4b5e-8e51-7a8ab5425ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:50.136705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b8a1b-80b2-4b5e-8e51-7a8ab5425ec1 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:50.137567 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b8a1b-80b2-4b5e-8e51-7a8ab5425ec1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:50.139008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b8a1b-80b2-4b5e-8e51-7a8ab5425ec1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:50.186896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ed03-400d-4296-8332-37e9c6b1b88b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:50.225419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0e7a5-044b-4982-86ac-6d9c9fe74ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:50.226050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0e7a5-044b-4982-86ac-6d9c9fe74ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:50.226333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0e7a5-044b-4982-86ac-6d9c9fe74ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:50.226606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0e7a5-044b-4982-86ac-6d9c9fe74ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:50.227297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0e7a5-044b-4982-86ac-6d9c9fe74ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:50.227601 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0e7a5-044b-4982-86ac-6d9c9fe74ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:50.229023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0e7a5-044b-4982-86ac-6d9c9fe74ee3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:50.242004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 239/472] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:50.242934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0e7a5-044b-4982-86ac-6d9c9fe74ee3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:50.244723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 234/473] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:49 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:50.248800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:50.249760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b8a1b-80b2-4b5e-8e51-7a8ab5425ec1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:50.384211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0e7a5-044b-4982-86ac-6d9c9fe74ee3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:50.385328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:50.408353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b8a1b-80b2-4b5e-8e51-7a8ab5425ec1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:50.424907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c04a8-8add-481f-b030-344b5cef4e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:50.425462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c04a8-8add-481f-b030-344b5cef4e00 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:50.425738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c04a8-8add-481f-b030-344b5cef4e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:50.426007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c04a8-8add-481f-b030-344b5cef4e00 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:50.426755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c04a8-8add-481f-b030-344b5cef4e00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:50.428202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c04a8-8add-481f-b030-344b5cef4e00 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:50.453943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94981e-0f4e-4298-8af4-6ec832e00aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:50.455461 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94981e-0f4e-4298-8af4-6ec832e00aef None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:50.455919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94981e-0f4e-4298-8af4-6ec832e00aef None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:50.456390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94981e-0f4e-4298-8af4-6ec832e00aef None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:50.457691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94981e-0f4e-4298-8af4-6ec832e00aef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:50.459252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94981e-0f4e-4298-8af4-6ec832e00aef None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:50.552531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 240/474] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:50 2022] POST /identity/v3/users => generated 248 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:50.553804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac9cc0-3532-48af-bb12-2863453f9102 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:50.554169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac9cc0-3532-48af-bb12-2863453f9102 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:50.554435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac9cc0-3532-48af-bb12-2863453f9102 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:50.555955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 241/475] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:50.563896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594e12-f189-4a14-8459-282249e73a87 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:50.564580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594e12-f189-4a14-8459-282249e73a87 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:50.565107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594e12-f189-4a14-8459-282249e73a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:50.586436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-71594e12-f189-4a14-8459-282249e73a87 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:50.588228 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-71594e12-f189-4a14-8459-282249e73a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:50.605317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 235/476] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:50 2022] POST /identity/v3/users => generated 249 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:50.692885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:50.715712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 242/477] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:50.747129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94981e-0f4e-4298-8af4-6ec832e00aef None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:50.858146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94981e-0f4e-4298-8af4-6ec832e00aef None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:50.894870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:50.895491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:50.895768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:50.896037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:50.896759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:50.898159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:50.933830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.sql.core [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 17:47:50.933830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 17:47:50.933830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [parameters: {'id': '28c1670d1e084120ac40961d982799c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 17:47:50.933830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80524) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result.read() Jul 28 17:47:50.950253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:47:50.951250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application yield resource Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise self.value Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application session.commit() Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 17:47:50.952178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.session.flush() Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application compat.raise_( Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 17:47:50.953088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:47:50.953929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result.read() Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:47:50.955383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [parameters: {'id': '28c1670d1e084120ac40961d982799c0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:50.956180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 17:47:50.961822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:50.964727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 236/478] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 28 17:47:50 2022] POST /identity/v3/roles => generated 144 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:50.964869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594e12-f189-4a14-8459-282249e73a87 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:51.128072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594e12-f189-4a14-8459-282249e73a87 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:51.187579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bec38b-130d-4e0a-86ec-affa1acc2af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:51.188226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bec38b-130d-4e0a-86ec-affa1acc2af6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:51.188501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bec38b-130d-4e0a-86ec-affa1acc2af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:51.188844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bec38b-130d-4e0a-86ec-affa1acc2af6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:51.205584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bec38b-130d-4e0a-86ec-affa1acc2af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-74bec38b-130d-4e0a-86ec-affa1acc2af6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:51.210427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:51.211291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 17:47:51.212107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:51.215903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 243/479] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:47:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:51.217149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:51.233444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:51.371527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8faf8-8839-4737-890a-ccb88d28734e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:51.421246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021ae94-5cf0-4226-aeca-12421cac5872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:51.421863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ae94-5cf0-4226-aeca-12421cac5872 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:51.422144 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ae94-5cf0-4226-aeca-12421cac5872 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:51.422416 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ae94-5cf0-4226-aeca-12421cac5872 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:51.423198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021ae94-5cf0-4226-aeca-12421cac5872 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:51.423510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021ae94-5cf0-4226-aeca-12421cac5872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:51.424899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021ae94-5cf0-4226-aeca-12421cac5872 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:51.433515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 237/480] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:52.536651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f75cb-ab72-4786-aced-f9d4734ddcfe None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:52.537222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f75cb-ab72-4786-aced-f9d4734ddcfe None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:52.537222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f75cb-ab72-4786-aced-f9d4734ddcfe None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:52.538735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 244/481] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:52.543720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c514-c807-45ae-bc44-7a91b28db33e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:52.544603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c514-c807-45ae-bc44-7a91b28db33e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:52.545123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c514-c807-45ae-bc44-7a91b28db33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:52.581626 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5f69c514-c807-45ae-bc44-7a91b28db33e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:52.582813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5f69c514-c807-45ae-bc44-7a91b28db33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:52.650445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccefb3c-f4a9-45a5-8af6-b3bd0061922b None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:52.651052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccefb3c-f4a9-45a5-8af6-b3bd0061922b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:52.651510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccefb3c-f4a9-45a5-8af6-b3bd0061922b None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:52.653884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 245/482] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:52.662317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e5398-f87e-41ac-9fcb-bde59bf7fd7d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:52.662867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e5398-f87e-41ac-9fcb-bde59bf7fd7d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:52.663342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e5398-f87e-41ac-9fcb-bde59bf7fd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:52.665297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:52.671694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 238/483] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:52.694959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c514-c807-45ae-bc44-7a91b28db33e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:52.705897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c90e5398-f87e-41ac-9fcb-bde59bf7fd7d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:52.709481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c90e5398-f87e-41ac-9fcb-bde59bf7fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:52.803887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:52.844021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 246/484] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:52.883545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c514-c807-45ae-bc44-7a91b28db33e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:52.889621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e5398-f87e-41ac-9fcb-bde59bf7fd7d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:52.955999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096b5d2-2196-42e9-9e9b-ccdd735cc80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:52.956677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096b5d2-2196-42e9-9e9b-ccdd735cc80f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:52.956953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096b5d2-2196-42e9-9e9b-ccdd735cc80f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:52.957225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096b5d2-2196-42e9-9e9b-ccdd735cc80f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:52.985761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096b5d2-2196-42e9-9e9b-ccdd735cc80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4096b5d2-2196-42e9-9e9b-ccdd735cc80f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:52.990765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:52.991740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:52.992547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 239/485] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:47:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:52.997692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096b5d2-2196-42e9-9e9b-ccdd735cc80f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.019490 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e5398-f87e-41ac-9fcb-bde59bf7fd7d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:53.061974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6740be-2156-4d26-8705-2e61de603868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:53.062543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6740be-2156-4d26-8705-2e61de603868 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.062828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6740be-2156-4d26-8705-2e61de603868 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.063107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6740be-2156-4d26-8705-2e61de603868 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.088519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6740be-2156-4d26-8705-2e61de603868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-5c6740be-2156-4d26-8705-2e61de603868 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:53.093674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:53.094558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:53.095915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 247/486] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:47:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:53.102792 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6740be-2156-4d26-8705-2e61de603868 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.113506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:53.159943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:53.163962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096b5d2-2196-42e9-9e9b-ccdd735cc80f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:53.204027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216e453-3e36-43ac-a3ba-39981cfaf333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:53.205484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e453-3e36-43ac-a3ba-39981cfaf333 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.205871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e453-3e36-43ac-a3ba-39981cfaf333 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.206265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216e453-3e36-43ac-a3ba-39981cfaf333 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.207458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e453-3e36-43ac-a3ba-39981cfaf333 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:53.207458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e453-3e36-43ac-a3ba-39981cfaf333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:53.208949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216e453-3e36-43ac-a3ba-39981cfaf333 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:53.218145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 240/487] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:47:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:53.219348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5270aa0-6dd9-489d-b885-13a138d9e23f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.219784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5270aa0-6dd9-489d-b885-13a138d9e23f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.220231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5270aa0-6dd9-489d-b885-13a138d9e23f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.225604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 241/488] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:53.225604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5270aa0-6dd9-489d-b885-13a138d9e23f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.255278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6740be-2156-4d26-8705-2e61de603868 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:53.293728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc8642-fc77-4edd-8453-c9535ec7179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:53.294350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc8642-fc77-4edd-8453-c9535ec7179f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.294628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc8642-fc77-4edd-8453-c9535ec7179f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.294905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc8642-fc77-4edd-8453-c9535ec7179f None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.295628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc8642-fc77-4edd-8453-c9535ec7179f None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:53.295934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc8642-fc77-4edd-8453-c9535ec7179f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:53.297346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc8642-fc77-4edd-8453-c9535ec7179f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:53.305878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 248/489] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:47:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:53.307048 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523dcff-3a4f-4db2-8aa1-d3a564166a51 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.307338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523dcff-3a4f-4db2-8aa1-d3a564166a51 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.307613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523dcff-3a4f-4db2-8aa1-d3a564166a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.326994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8523dcff-3a4f-4db2-8aa1-d3a564166a51 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:53.328107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8523dcff-3a4f-4db2-8aa1-d3a564166a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:53.333294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5270aa0-6dd9-489d-b885-13a138d9e23f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:53.355983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:53.371244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea763-af20-46ba-84aa-efff7153d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:53.371888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea763-af20-46ba-84aa-efff7153d619 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.372167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea763-af20-46ba-84aa-efff7153d619 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.372519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea763-af20-46ba-84aa-efff7153d619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.383065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea763-af20-46ba-84aa-efff7153d619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:53.384501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea763-af20-46ba-84aa-efff7153d619 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9aeea763-af20-46ba-84aa-efff7153d619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:53.399830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:53.400901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:53.401919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:53.401919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:53.401919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:53.401919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:53.403574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 242/490] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:53.405129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a383-bc59-4ed9-acbf-e57d5cd6311c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.405473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a383-bc59-4ed9-acbf-e57d5cd6311c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.405796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a383-bc59-4ed9-acbf-e57d5cd6311c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.407207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 243/491] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:53.407798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93a383-bc59-4ed9-acbf-e57d5cd6311c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.416943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 249/492] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:53.417922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523dcff-3a4f-4db2-8aa1-d3a564166a51 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.450567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:53.518201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93a383-bc59-4ed9-acbf-e57d5cd6311c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:53.522904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523dcff-3a4f-4db2-8aa1-d3a564166a51 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:53.552736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112a26d-d9e8-49de-8694-fd836a7aad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:53.553955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112a26d-d9e8-49de-8694-fd836a7aad5a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.554254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112a26d-d9e8-49de-8694-fd836a7aad5a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.554521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112a26d-d9e8-49de-8694-fd836a7aad5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.565181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8d2d5-10e9-493a-a57b-f7c3ad9907b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:53.565903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d2d5-10e9-493a-a57b-f7c3ad9907b3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.566185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d2d5-10e9-493a-a57b-f7c3ad9907b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.566397 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8d2d5-10e9-493a-a57b-f7c3ad9907b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.566867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112a26d-d9e8-49de-8694-fd836a7aad5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:53.567069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d2d5-10e9-493a-a57b-f7c3ad9907b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:53.567375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d2d5-10e9-493a-a57b-f7c3ad9907b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:53.568271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112a26d-d9e8-49de-8694-fd836a7aad5a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:53.568733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8d2d5-10e9-493a-a57b-f7c3ad9907b3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:53.585309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 250/493] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:53.585309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122068-4839-47c9-9258-5674bc450e9d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.585309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122068-4839-47c9-9258-5674bc450e9d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.585309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122068-4839-47c9-9258-5674bc450e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5112a26d-d9e8-49de-8694-fd836a7aad5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:53.585655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:53.586432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:53.587273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:53.587273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:53.587273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:53.587273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:53.592865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 244/494] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:53.592865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112a26d-d9e8-49de-8694-fd836a7aad5a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.610247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-e3122068-4839-47c9-9258-5674bc450e9d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:53.611639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e3122068-4839-47c9-9258-5674bc450e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:53.619970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:53.684577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 251/495] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:53.686280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3122068-4839-47c9-9258-5674bc450e9d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.697995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112a26d-d9e8-49de-8694-fd836a7aad5a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:53.722237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:53.736703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753b48-9fb1-4877-bdea-464b00e2a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:53.737378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753b48-9fb1-4877-bdea-464b00e2a89e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.737659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753b48-9fb1-4877-bdea-464b00e2a89e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.737935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753b48-9fb1-4877-bdea-464b00e2a89e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.748753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c753b48-9fb1-4877-bdea-464b00e2a89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9c753b48-9fb1-4877-bdea-464b00e2a89e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:53.754627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:53.755568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:53.756357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 245/496] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:47:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:53.757662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753b48-9fb1-4877-bdea-464b00e2a89e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.804856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3122068-4839-47c9-9258-5674bc450e9d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:53.842790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559b8a0-1fd5-4157-aeeb-a75af02ae42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:53.843348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559b8a0-1fd5-4157-aeeb-a75af02ae42e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.843637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559b8a0-1fd5-4157-aeeb-a75af02ae42e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.843897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559b8a0-1fd5-4157-aeeb-a75af02ae42e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.847583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:53.851880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559b8a0-1fd5-4157-aeeb-a75af02ae42e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:53.853136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559b8a0-1fd5-4157-aeeb-a75af02ae42e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:53.864143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753b48-9fb1-4877-bdea-464b00e2a89e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-a559b8a0-1fd5-4157-aeeb-a75af02ae42e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:47:53.866782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:53.867830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 252/497] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 28 17:47:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:53.868723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559b8a0-1fd5-4157-aeeb-a75af02ae42e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.906293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b90fde-2378-4f4a-ba87-3e30afee119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:53.906909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b90fde-2378-4f4a-ba87-3e30afee119d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:53.907189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b90fde-2378-4f4a-ba87-3e30afee119d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:53.907484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b90fde-2378-4f4a-ba87-3e30afee119d None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:53.908174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b90fde-2378-4f4a-ba87-3e30afee119d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:53.908473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b90fde-2378-4f4a-ba87-3e30afee119d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:53.909933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b90fde-2378-4f4a-ba87-3e30afee119d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:53.927648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 246/498] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:53.927648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b90fde-2378-4f4a-ba87-3e30afee119d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:53.960235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:53.980078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559b8a0-1fd5-4157-aeeb-a75af02ae42e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.017548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eb91b-9fc2-4d4e-8e1a-6fd9b28f2378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.018336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eb91b-9fc2-4d4e-8e1a-6fd9b28f2378 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.018694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eb91b-9fc2-4d4e-8e1a-6fd9b28f2378 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.019030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13eb91b-9fc2-4d4e-8e1a-6fd9b28f2378 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.025543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b90fde-2378-4f4a-ba87-3e30afee119d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.029663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13eb91b-9fc2-4d4e-8e1a-6fd9b28f2378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d13eb91b-9fc2-4d4e-8e1a-6fd9b28f2378 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:54.035091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:54.036180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:54.037253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 253/499] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:47:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:54.037983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eb91b-9fc2-4d4e-8e1a-6fd9b28f2378 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.067015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c7bf3-68d8-4769-a0a8-38befbe0a7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.067635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c7bf3-68d8-4769-a0a8-38befbe0a7ef None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.067918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c7bf3-68d8-4769-a0a8-38befbe0a7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.068195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c7bf3-68d8-4769-a0a8-38befbe0a7ef None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.068953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c7bf3-68d8-4769-a0a8-38befbe0a7ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:54.069261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c7bf3-68d8-4769-a0a8-38befbe0a7ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.070654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c7bf3-68d8-4769-a0a8-38befbe0a7ef None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.079876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 247/500] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:47:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:54.080547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c7bf3-68d8-4769-a0a8-38befbe0a7ef None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.090175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.149045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13eb91b-9fc2-4d4e-8e1a-6fd9b28f2378 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.182511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3733b-38a9-451c-a7e4-8e6dc2f24836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.182656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c7bf3-68d8-4769-a0a8-38befbe0a7ef None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.183121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3733b-38a9-451c-a7e4-8e6dc2f24836 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.183398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3733b-38a9-451c-a7e4-8e6dc2f24836 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.183668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3733b-38a9-451c-a7e4-8e6dc2f24836 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.184453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3733b-38a9-451c-a7e4-8e6dc2f24836 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:54.184758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3733b-38a9-451c-a7e4-8e6dc2f24836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.186489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3733b-38a9-451c-a7e4-8e6dc2f24836 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.217066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e8c0d-637f-4656-8d3e-41653fe1b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.217697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e8c0d-637f-4656-8d3e-41653fe1b91e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.217975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e8c0d-637f-4656-8d3e-41653fe1b91e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.218247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e8c0d-637f-4656-8d3e-41653fe1b91e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.218539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.222936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 254/501] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:54.223733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3733b-38a9-451c-a7e4-8e6dc2f24836 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.225776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e8c0d-637f-4656-8d3e-41653fe1b91e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.227249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e8c0d-637f-4656-8d3e-41653fe1b91e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c05e8c0d-637f-4656-8d3e-41653fe1b91e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:47:54.240415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:54.241576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 248/502] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:54.242462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e8c0d-637f-4656-8d3e-41653fe1b91e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.306397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.325985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3733b-38a9-451c-a7e4-8e6dc2f24836 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.340744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e8c0d-637f-4656-8d3e-41653fe1b91e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.360896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b7f0f-456d-47d7-9fa5-35380188ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.361562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b7f0f-456d-47d7-9fa5-35380188ed05 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.361846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b7f0f-456d-47d7-9fa5-35380188ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.362124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b7f0f-456d-47d7-9fa5-35380188ed05 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.362847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b7f0f-456d-47d7-9fa5-35380188ed05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:54.363157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b7f0f-456d-47d7-9fa5-35380188ed05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.364560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b7f0f-456d-47d7-9fa5-35380188ed05 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.373019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 255/503] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:54.374027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3dca-2bd1-4905-9e58-b68eca013b6f None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.374318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3dca-2bd1-4905-9e58-b68eca013b6f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.374590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff3dca-2bd1-4905-9e58-b68eca013b6f None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.375790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 256/504] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:54.377012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff3dca-2bd1-4905-9e58-b68eca013b6f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.379330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb10121-ae1b-45a9-9631-a216d93674b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.379969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb10121-ae1b-45a9-9631-a216d93674b1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.380250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb10121-ae1b-45a9-9631-a216d93674b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.380585 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb10121-ae1b-45a9-9631-a216d93674b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.391412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb10121-ae1b-45a9-9631-a216d93674b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.392948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb10121-ae1b-45a9-9631-a216d93674b1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8fb10121-ae1b-45a9-9631-a216d93674b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:54.406808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:54.408130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:54.413488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:54.413488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:54.413488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:54.413488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:54.413488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 249/505] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:54.413488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb10121-ae1b-45a9-9631-a216d93674b1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.444897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.483320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff3dca-2bd1-4905-9e58-b68eca013b6f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.508968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb10121-ae1b-45a9-9631-a216d93674b1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.517539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ca487-dcf1-4a1b-981d-004c2c9d7587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.518150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ca487-dcf1-4a1b-981d-004c2c9d7587 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.518425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ca487-dcf1-4a1b-981d-004c2c9d7587 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.518695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ca487-dcf1-4a1b-981d-004c2c9d7587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.525559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.542859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0140-301b-4c3c-9ddd-d3d1a73af38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.543468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0140-301b-4c3c-9ddd-d3d1a73af38e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.543751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0140-301b-4c3c-9ddd-d3d1a73af38e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.544028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0140-301b-4c3c-9ddd-d3d1a73af38e None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.544841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f0140-301b-4c3c-9ddd-d3d1a73af38e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:54.545152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f0140-301b-4c3c-9ddd-d3d1a73af38e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.546579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f0140-301b-4c3c-9ddd-d3d1a73af38e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.583766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 250/506] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:54.584597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0140-301b-4c3c-9ddd-d3d1a73af38e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.585561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ca487-dcf1-4a1b-981d-004c2c9d7587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.587023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ca487-dcf1-4a1b-981d-004c2c9d7587 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.647864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.682690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0140-301b-4c3c-9ddd-d3d1a73af38e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.687964 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 257/507] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:54.690606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d304d2-e6ac-47f0-b71d-ff4ba0152313 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.690896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d304d2-e6ac-47f0-b71d-ff4ba0152313 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.691171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d304d2-e6ac-47f0-b71d-ff4ba0152313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.708184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-40d304d2-e6ac-47f0-b71d-ff4ba0152313 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:54.709405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-40d304d2-e6ac-47f0-b71d-ff4ba0152313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:54.719103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88cd4-869e-49fc-bc92-9278c912127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.719812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88cd4-869e-49fc-bc92-9278c912127b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.720160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88cd4-869e-49fc-bc92-9278c912127b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.720438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88cd4-869e-49fc-bc92-9278c912127b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.730313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c88cd4-869e-49fc-bc92-9278c912127b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.731756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c88cd4-869e-49fc-bc92-9278c912127b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f4c88cd4-869e-49fc-bc92-9278c912127b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:54.746656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:54.747493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:54.748663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:54.748663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:54.748663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:54.748663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:54.748663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 251/508] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:54.749148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88cd4-869e-49fc-bc92-9278c912127b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.776302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.780171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 258/509] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:54.780859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d304d2-e6ac-47f0-b71d-ff4ba0152313 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.852965 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88cd4-869e-49fc-bc92-9278c912127b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.870687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.879156 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d304d2-e6ac-47f0-b71d-ff4ba0152313 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:54.886289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c837c-ffbf-4e17-8fcc-36b884e71ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.886901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c837c-ffbf-4e17-8fcc-36b884e71ccb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.887179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c837c-ffbf-4e17-8fcc-36b884e71ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.887451 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c837c-ffbf-4e17-8fcc-36b884e71ccb None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.888183 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c837c-ffbf-4e17-8fcc-36b884e71ccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:54.888492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c837c-ffbf-4e17-8fcc-36b884e71ccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.889894 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c837c-ffbf-4e17-8fcc-36b884e71ccb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.901253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 252/510] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:54.902036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c837c-ffbf-4e17-8fcc-36b884e71ccb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:54.913424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3698fd-0263-4763-b23e-0a3f87f2915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:54.914043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3698fd-0263-4763-b23e-0a3f87f2915a None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:54.914326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3698fd-0263-4763-b23e-0a3f87f2915a None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:54.914600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3698fd-0263-4763-b23e-0a3f87f2915a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:54.982323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3698fd-0263-4763-b23e-0a3f87f2915a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:54.983708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3698fd-0263-4763-b23e-0a3f87f2915a None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:54.987477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:54.998902 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c837c-ffbf-4e17-8fcc-36b884e71ccb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.033333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8436234-3f00-4520-ba55-71ad2959a809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.033966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436234-3f00-4520-ba55-71ad2959a809 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.034245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436234-3f00-4520-ba55-71ad2959a809 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.034519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436234-3f00-4520-ba55-71ad2959a809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.044555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8436234-3f00-4520-ba55-71ad2959a809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.046120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8436234-3f00-4520-ba55-71ad2959a809 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c8436234-3f00-4520-ba55-71ad2959a809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:55.060698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:55.061685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:55.062518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:55.062518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:55.062518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:55.062518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:55.062518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 253/511] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:55.062789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8436234-3f00-4520-ba55-71ad2959a809 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.076916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.085942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 259/512] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:55.086801 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3698fd-0263-4763-b23e-0a3f87f2915a None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.171450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8436234-3f00-4520-ba55-71ad2959a809 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.189668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3698fd-0263-4763-b23e-0a3f87f2915a None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.205600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c781ef-22d6-485b-ae8e-2905f061b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.206218 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c781ef-22d6-485b-ae8e-2905f061b812 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.206498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c781ef-22d6-485b-ae8e-2905f061b812 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.206772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c781ef-22d6-485b-ae8e-2905f061b812 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.207459 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c781ef-22d6-485b-ae8e-2905f061b812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:55.207761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c781ef-22d6-485b-ae8e-2905f061b812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.209187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c781ef-22d6-485b-ae8e-2905f061b812 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.217679 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.221348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 254/513] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:55.222126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c781ef-22d6-485b-ae8e-2905f061b812 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.223097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6281708-7a59-4a59-a6b1-2aa37e33d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.223741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6281708-7a59-4a59-a6b1-2aa37e33d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.224021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6281708-7a59-4a59-a6b1-2aa37e33d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.224293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6281708-7a59-4a59-a6b1-2aa37e33d5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.234578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6281708-7a59-4a59-a6b1-2aa37e33d5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.236058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6281708-7a59-4a59-a6b1-2aa37e33d5a1 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d6281708-7a59-4a59-a6b1-2aa37e33d5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:55.250874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:55.252236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:55.253423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:55.253423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:55.253423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:55.253423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:55.253423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 260/514] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:55.253423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6281708-7a59-4a59-a6b1-2aa37e33d5a1 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.298662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.324981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c781ef-22d6-485b-ae8e-2905f061b812 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.352740 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6281708-7a59-4a59-a6b1-2aa37e33d5a1 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.358899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd4498-0447-4818-9471-9e709fe6565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.359535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd4498-0447-4818-9471-9e709fe6565d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.359805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd4498-0447-4818-9471-9e709fe6565d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.360075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd4498-0447-4818-9471-9e709fe6565d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.367445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd4498-0447-4818-9471-9e709fe6565d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.368903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd4498-0447-4818-9471-9e709fe6565d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-69fd4498-0447-4818-9471-9e709fe6565d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:47:55.380177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:55.381252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 255/515] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:55.382126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd4498-0447-4818-9471-9e709fe6565d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.390456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f800ba-3d4e-4b94-bcaf-f25697e19502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.391072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f800ba-3d4e-4b94-bcaf-f25697e19502 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.391351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f800ba-3d4e-4b94-bcaf-f25697e19502 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.391673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f800ba-3d4e-4b94-bcaf-f25697e19502 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.392918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f800ba-3d4e-4b94-bcaf-f25697e19502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:55.393221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f800ba-3d4e-4b94-bcaf-f25697e19502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.394586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f800ba-3d4e-4b94-bcaf-f25697e19502 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.406238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 261/516] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:55.407005 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f800ba-3d4e-4b94-bcaf-f25697e19502 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.445583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.485696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd4498-0447-4818-9471-9e709fe6565d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.509783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f800ba-3d4e-4b94-bcaf-f25697e19502 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.512843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.518602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65709a9-f29a-4386-b860-93827ea7d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.519232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65709a9-f29a-4386-b860-93827ea7d207 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.519510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65709a9-f29a-4386-b860-93827ea7d207 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.519781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65709a9-f29a-4386-b860-93827ea7d207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.530141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65709a9-f29a-4386-b860-93827ea7d207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.531569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65709a9-f29a-4386-b860-93827ea7d207 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.544324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e768a-addd-42ae-bce5-04bbecd4b91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.544978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e768a-addd-42ae-bce5-04bbecd4b91c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.545260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e768a-addd-42ae-bce5-04bbecd4b91c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.545530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e768a-addd-42ae-bce5-04bbecd4b91c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c65709a9-f29a-4386-b860-93827ea7d207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:55.546257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:55.547246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:55.548849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:55.548849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:55.548849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:55.548849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:55.548849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 256/517] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:55.548849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65709a9-f29a-4386-b860-93827ea7d207 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.555903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e768a-addd-42ae-bce5-04bbecd4b91c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.557831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e768a-addd-42ae-bce5-04bbecd4b91c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-931e768a-addd-42ae-bce5-04bbecd4b91c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:47:55.570995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:55.572064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 262/518] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:55.573027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e768a-addd-42ae-bce5-04bbecd4b91c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.652870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65709a9-f29a-4386-b860-93827ea7d207 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.665664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.676479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e768a-addd-42ae-bce5-04bbecd4b91c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.690748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469064c2-d2ab-4ab6-927c-c418fc4841d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.691361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469064c2-d2ab-4ab6-927c-c418fc4841d4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.691637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469064c2-d2ab-4ab6-927c-c418fc4841d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.691916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469064c2-d2ab-4ab6-927c-c418fc4841d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.692612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469064c2-d2ab-4ab6-927c-c418fc4841d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:55.693121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469064c2-d2ab-4ab6-927c-c418fc4841d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.694924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469064c2-d2ab-4ab6-927c-c418fc4841d4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.706328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 257/519] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:55.707100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469064c2-d2ab-4ab6-927c-c418fc4841d4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.712168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d5bb-2395-4465-9769-27751a3c6f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.712911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d5bb-2395-4465-9769-27751a3c6f4b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.713191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d5bb-2395-4465-9769-27751a3c6f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.713462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d5bb-2395-4465-9769-27751a3c6f4b None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.714246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5d5bb-2395-4465-9769-27751a3c6f4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:55.714547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5d5bb-2395-4465-9769-27751a3c6f4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.715972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5d5bb-2395-4465-9769-27751a3c6f4b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.732727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 263/520] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:55.733530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d5bb-2395-4465-9769-27751a3c6f4b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.757440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.813682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469064c2-d2ab-4ab6-927c-c418fc4841d4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.833045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d5bb-2395-4465-9769-27751a3c6f4b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.847629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d7b1b-137f-48bf-9c02-7c171c8c4ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.848255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d7b1b-137f-48bf-9c02-7c171c8c4ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.848533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d7b1b-137f-48bf-9c02-7c171c8c4ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.848819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d7b1b-137f-48bf-9c02-7c171c8c4ff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.855426 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d7b1b-137f-48bf-9c02-7c171c8c4ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.856881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d7b1b-137f-48bf-9c02-7c171c8c4ff8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.866616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca559a-3dc6-4c4b-b798-eed874a8d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:55.867221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca559a-3dc6-4c4b-b798-eed874a8d840 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:55.867498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca559a-3dc6-4c4b-b798-eed874a8d840 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:55.867770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca559a-3dc6-4c4b-b798-eed874a8d840 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c91d7b1b-137f-48bf-9c02-7c171c8c4ff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:47:55.868432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:55.869464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:55.875111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:47:55.875111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:47:55.875111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:47:55.875111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:47:55.875111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:47:55.875111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:47:55.875111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:47:55.875111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:55.875646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca559a-3dc6-4c4b-b798-eed874a8d840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:55.875646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca559a-3dc6-4c4b-b798-eed874a8d840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:55.875792 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 258/521] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:55.875881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca559a-3dc6-4c4b-b798-eed874a8d840 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:55.875963 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d7b1b-137f-48bf-9c02-7c171c8c4ff8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.887934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 264/522] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:55.888753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca559a-3dc6-4c4b-b798-eed874a8d840 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:55.908508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.976561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:55.978475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d7b1b-137f-48bf-9c02-7c171c8c4ff8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:55.993723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca559a-3dc6-4c4b-b798-eed874a8d840 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:56.012059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc08992-8510-47e0-ac4e-328503e2f4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:56.012616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08992-8510-47e0-ac4e-328503e2f4fb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.012927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08992-8510-47e0-ac4e-328503e2f4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.013203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08992-8510-47e0-ac4e-328503e2f4fb None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.014016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc08992-8510-47e0-ac4e-328503e2f4fb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:56.014305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc08992-8510-47e0-ac4e-328503e2f4fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:56.015729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc08992-8510-47e0-ac4e-328503e2f4fb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:56.027227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9df03c-2e75-45f8-a758-36ffde04796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:56.027833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9df03c-2e75-45f8-a758-36ffde04796a None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.028112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9df03c-2e75-45f8-a758-36ffde04796a None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.028391 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9df03c-2e75-45f8-a758-36ffde04796a None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.029092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9df03c-2e75-45f8-a758-36ffde04796a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:56.030509 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9df03c-2e75-45f8-a758-36ffde04796a None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:56.033356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 259/523] 10.222.0.67 () {56 vars in 1139 bytes} [Thu Jul 28 17:47:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:56.034143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc08992-8510-47e0-ac4e-328503e2f4fb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:56.123173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:56.132495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc08992-8510-47e0-ac4e-328503e2f4fb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:56.165159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733cdc-2549-47c7-8fa7-de27227f6d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:56.165772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733cdc-2549-47c7-8fa7-de27227f6d59 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.166054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733cdc-2549-47c7-8fa7-de27227f6d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.166327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733cdc-2549-47c7-8fa7-de27227f6d59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.175159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 265/524] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:47:55 2022] POST /identity/v3/users => generated 247 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:47:56.175979 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9df03c-2e75-45f8-a758-36ffde04796a None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:56.252031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733cdc-2549-47c7-8fa7-de27227f6d59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:56.253549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733cdc-2549-47c7-8fa7-de27227f6d59 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:56.313864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9df03c-2e75-45f8-a758-36ffde04796a None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:56.355482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee09af-8b31-4bf1-89c1-1d2d76780dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:56.356476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee09af-8b31-4bf1-89c1-1d2d76780dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.356949 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee09af-8b31-4bf1-89c1-1d2d76780dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.357230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee09af-8b31-4bf1-89c1-1d2d76780dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.358040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee09af-8b31-4bf1-89c1-1d2d76780dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:56.358386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee09af-8b31-4bf1-89c1-1d2d76780dd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:56.359841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee09af-8b31-4bf1-89c1-1d2d76780dd0 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:56.364622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:56.376313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:56.378906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 260/525] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:56.379690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733cdc-2549-47c7-8fa7-de27227f6d59 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:56.380588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 266/526] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:56.385896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee09af-8b31-4bf1-89c1-1d2d76780dd0 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:56.492310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee09af-8b31-4bf1-89c1-1d2d76780dd0 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:56.492854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733cdc-2549-47c7-8fa7-de27227f6d59 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:56.527241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b245cc4-7873-4b82-8463-abea99899db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:56.527948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245cc4-7873-4b82-8463-abea99899db2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.528281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f3d6c-3568-4430-baaf-46615fb35aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:56.528415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245cc4-7873-4b82-8463-abea99899db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.528678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245cc4-7873-4b82-8463-abea99899db2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.528949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f3d6c-3568-4430-baaf-46615fb35aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.529229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f3d6c-3568-4430-baaf-46615fb35aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.529502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f3d6c-3568-4430-baaf-46615fb35aa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.537061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f3d6c-3568-4430-baaf-46615fb35aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:56.538634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f3d6c-3568-4430-baaf-46615fb35aa5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ec8f3d6c-3568-4430-baaf-46615fb35aa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:47:56.551616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:56.552491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:56.553430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:47:56.553430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:47:56.553430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:47:56.553430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:47:56.553430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:47:56.553430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:47:56.553430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:47:56.553430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:56.558452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 261/527] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:56.558452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f3d6c-3568-4430-baaf-46615fb35aa5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:56.608276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:56.612224 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b245cc4-7873-4b82-8463-abea99899db2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:56.613966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b245cc4-7873-4b82-8463-abea99899db2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:56.652185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:56.706719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f3d6c-3568-4430-baaf-46615fb35aa5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:56.723287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 267/528] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:47:56.724129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b245cc4-7873-4b82-8463-abea99899db2 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:56.748745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ee20-7e34-4b23-9c9f-44f4365063dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:56.749416 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ee20-7e34-4b23-9c9f-44f4365063dd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.749700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ee20-7e34-4b23-9c9f-44f4365063dd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.749974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ee20-7e34-4b23-9c9f-44f4365063dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.761975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93ee20-7e34-4b23-9c9f-44f4365063dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:56.763469 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93ee20-7e34-4b23-9c9f-44f4365063dd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-db93ee20-7e34-4b23-9c9f-44f4365063dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:56.779573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:56.780462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:56.781664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:56.781664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:56.781664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:56.781664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:56.781664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 262/529] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:56.781945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ee20-7e34-4b23-9c9f-44f4365063dd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:56.829079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:56.832523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b245cc4-7873-4b82-8463-abea99899db2 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:56.868218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f4224-023e-4a3f-ab5a-ad62ca897839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:56.868750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f4224-023e-4a3f-ab5a-ad62ca897839 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.869066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f4224-023e-4a3f-ab5a-ad62ca897839 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.869341 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f4224-023e-4a3f-ab5a-ad62ca897839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.870136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f4224-023e-4a3f-ab5a-ad62ca897839 None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=cb85b3e1dc464438ac007c1b09ea7fd3) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:56.870451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f4224-023e-4a3f-ab5a-ad62ca897839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:56.871895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f4224-023e-4a3f-ab5a-ad62ca897839 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:56.884808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 268/530] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:56 2022] GET /identity/v3/role_assignments?user.id=cb85b3e1dc464438ac007c1b09ea7fd3&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:56.884808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f4224-023e-4a3f-ab5a-ad62ca897839 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:56.901220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ee20-7e34-4b23-9c9f-44f4365063dd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:56.904115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:56.964212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe264068-98c9-40b6-8014-cf52ced573ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:56.965207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264068-98c9-40b6-8014-cf52ced573ad None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:56.965642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264068-98c9-40b6-8014-cf52ced573ad None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:56.966065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264068-98c9-40b6-8014-cf52ced573ad None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:56.967062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264068-98c9-40b6-8014-cf52ced573ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:56.967528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264068-98c9-40b6-8014-cf52ced573ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:56.969304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264068-98c9-40b6-8014-cf52ced573ad None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:56.990521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 263/531] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:56.991712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe264068-98c9-40b6-8014-cf52ced573ad None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.031145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f4224-023e-4a3f-ab5a-ad62ca897839 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.078383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b55385-574c-422d-83dd-e2f76afcd367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.079105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b55385-574c-422d-83dd-e2f76afcd367 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.079840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b55385-574c-422d-83dd-e2f76afcd367 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.080131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b55385-574c-422d-83dd-e2f76afcd367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.091344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b55385-574c-422d-83dd-e2f76afcd367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.092819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b55385-574c-422d-83dd-e2f76afcd367 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-62b55385-574c-422d-83dd-e2f76afcd367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:57.110095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:57.111666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:57.112551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:57.112551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:57.112551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:57.112551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:57.116357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 269/532] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:57.117388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b55385-574c-422d-83dd-e2f76afcd367 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.117632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe264068-98c9-40b6-8014-cf52ced573ad None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.134256 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:57.154319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045db63a-142e-4ae6-9415-1c05cfe7edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.155238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db63a-142e-4ae6-9415-1c05cfe7edd7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.155717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db63a-142e-4ae6-9415-1c05cfe7edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.156223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045db63a-142e-4ae6-9415-1c05cfe7edd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.157235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045db63a-142e-4ae6-9415-1c05cfe7edd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:57.157787 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045db63a-142e-4ae6-9415-1c05cfe7edd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.159322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045db63a-142e-4ae6-9415-1c05cfe7edd7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.175075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 264/533] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:57.176280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045db63a-142e-4ae6-9415-1c05cfe7edd7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.201974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:57.234704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b55385-574c-422d-83dd-e2f76afcd367 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.271523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f966b-cb92-43ea-853c-cf9b348f4c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.272138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f966b-cb92-43ea-853c-cf9b348f4c8b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.272417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f966b-cb92-43ea-853c-cf9b348f4c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.272687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f966b-cb92-43ea-853c-cf9b348f4c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.273502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f966b-cb92-43ea-853c-cf9b348f4c8b None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=3a4c879f65c24edea2404cb74ac37025) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:57.273941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f966b-cb92-43ea-853c-cf9b348f4c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.275438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f966b-cb92-43ea-853c-cf9b348f4c8b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.281887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 270/534] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/role_assignments?user.id=3a4c879f65c24edea2404cb74ac37025&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:57.283218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f966b-cb92-43ea-853c-cf9b348f4c8b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.285142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045db63a-142e-4ae6-9415-1c05cfe7edd7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.325937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6df6c-b62b-440e-836e-39220c14fdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.326563 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6df6c-b62b-440e-836e-39220c14fdda None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.326843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6df6c-b62b-440e-836e-39220c14fdda None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.327117 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6df6c-b62b-440e-836e-39220c14fdda None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.327817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6df6c-b62b-440e-836e-39220c14fdda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:57.328183 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6df6c-b62b-440e-836e-39220c14fdda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.329653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6df6c-b62b-440e-836e-39220c14fdda None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.343307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 265/535] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:57.358947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6df6c-b62b-440e-836e-39220c14fdda None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.382082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:57.406857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f966b-cb92-43ea-853c-cf9b348f4c8b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.449009 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11ccea-b674-487b-99c0-8844069b129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.449666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11ccea-b674-487b-99c0-8844069b129c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.449944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11ccea-b674-487b-99c0-8844069b129c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.450216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11ccea-b674-487b-99c0-8844069b129c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.459570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:57.463499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11ccea-b674-487b-99c0-8844069b129c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.465458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11ccea-b674-487b-99c0-8844069b129c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.478938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6df6c-b62b-440e-836e-39220c14fdda None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-aa11ccea-b674-487b-99c0-8844069b129c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:47:57.484149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:57.485030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:57.486203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:47:57.486203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:47:57.486203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:47:57.486203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:47:57.486203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:47:57.486203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:47:57.486203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:47:57.486203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:57.488531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 271/536] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:57.495542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11ccea-b674-487b-99c0-8844069b129c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.518526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c94ea-5dac-486d-8bd4-79b4b82f156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.519320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c94ea-5dac-486d-8bd4-79b4b82f156b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.519617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c94ea-5dac-486d-8bd4-79b4b82f156b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.519804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c94ea-5dac-486d-8bd4-79b4b82f156b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.527033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c94ea-5dac-486d-8bd4-79b4b82f156b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.528616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c94ea-5dac-486d-8bd4-79b4b82f156b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-060c94ea-5dac-486d-8bd4-79b4b82f156b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:47:57.541334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:57.542280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:57.543146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:47:57.543146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:47:57.543146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:47:57.543146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:47:57.543146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:47:57.543146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:47:57.543146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:47:57.543146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:57.543146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 266/537] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:57.548478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c94ea-5dac-486d-8bd4-79b4b82f156b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.639298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11ccea-b674-487b-99c0-8844069b129c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.682725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b817d-2d12-4892-afc1-16036d60540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.683342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b817d-2d12-4892-afc1-16036d60540c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.683622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b817d-2d12-4892-afc1-16036d60540c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.683895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b817d-2d12-4892-afc1-16036d60540c None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.684645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b817d-2d12-4892-afc1-16036d60540c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:57.684980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b817d-2d12-4892-afc1-16036d60540c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.686680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b817d-2d12-4892-afc1-16036d60540c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.693608 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c94ea-5dac-486d-8bd4-79b4b82f156b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.711043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:57.721447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 272/538] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:57.727284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b817d-2d12-4892-afc1-16036d60540c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.775091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f770b39-9d0c-4c34-8d0a-694e2e8c2e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.776041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f770b39-9d0c-4c34-8d0a-694e2e8c2e3d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.776474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f770b39-9d0c-4c34-8d0a-694e2e8c2e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.776938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f770b39-9d0c-4c34-8d0a-694e2e8c2e3d None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.777933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f770b39-9d0c-4c34-8d0a-694e2e8c2e3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:57.778239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f770b39-9d0c-4c34-8d0a-694e2e8c2e3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.779665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f770b39-9d0c-4c34-8d0a-694e2e8c2e3d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.808438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 267/539] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:57.814389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f770b39-9d0c-4c34-8d0a-694e2e8c2e3d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:57.822981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:57.873101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b817d-2d12-4892-afc1-16036d60540c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:57.916605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145048c6-a2ae-452d-a5bb-e6c89ceec401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:57.918601 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145048c6-a2ae-452d-a5bb-e6c89ceec401 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:57.918851 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145048c6-a2ae-452d-a5bb-e6c89ceec401 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:57.919126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145048c6-a2ae-452d-a5bb-e6c89ceec401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:57.919926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145048c6-a2ae-452d-a5bb-e6c89ceec401 None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=18138af1ea504faca84b0cc2034ddd36) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:57.920234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145048c6-a2ae-452d-a5bb-e6c89ceec401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:57.921719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145048c6-a2ae-452d-a5bb-e6c89ceec401 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:57.935851 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 273/540] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/role_assignments?user.id=18138af1ea504faca84b0cc2034ddd36&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:58.007908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f770b39-9d0c-4c34-8d0a-694e2e8c2e3d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:58.064223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c367d-bbdb-4d68-9181-a4fbfeb2a6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:58.064911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c367d-bbdb-4d68-9181-a4fbfeb2a6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:58.065199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c367d-bbdb-4d68-9181-a4fbfeb2a6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:58.065476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c367d-bbdb-4d68-9181-a4fbfeb2a6b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:58.066287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c367d-bbdb-4d68-9181-a4fbfeb2a6b0 None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=0116171a83f5444d91ce0ea2439a9bd2) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:58.066597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c367d-bbdb-4d68-9181-a4fbfeb2a6b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:58.068126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c367d-bbdb-4d68-9181-a4fbfeb2a6b0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:58.074785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 268/541] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:47:57 2022] GET /identity/v3/role_assignments?user.id=0116171a83f5444d91ce0ea2439a9bd2&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:47:58.449978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e2ffc-1873-4c38-97d2-332baf0c27cb None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:58.450376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e2ffc-1873-4c38-97d2-332baf0c27cb None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:58.450550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e2ffc-1873-4c38-97d2-332baf0c27cb None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:58.452132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 274/542] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:47:58.458137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa40c2d-f59c-44bd-a7f1-07d918ad6885 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:58.458427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa40c2d-f59c-44bd-a7f1-07d918ad6885 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:58.458707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa40c2d-f59c-44bd-a7f1-07d918ad6885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:58.486286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5fa40c2d-f59c-44bd-a7f1-07d918ad6885 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:58.487486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5fa40c2d-f59c-44bd-a7f1-07d918ad6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:58.550376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:58.558353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 269/543] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:47:58.593458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e2ffc-1873-4c38-97d2-332baf0c27cb None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:58.690518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:58.739591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e2ffc-1873-4c38-97d2-332baf0c27cb None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:58.791401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88356f18-60aa-4673-8e27-4a8df62a0fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:58.792058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88356f18-60aa-4673-8e27-4a8df62a0fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:58.792340 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88356f18-60aa-4673-8e27-4a8df62a0fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:58.792615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88356f18-60aa-4673-8e27-4a8df62a0fa9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:58.813047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88356f18-60aa-4673-8e27-4a8df62a0fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-88356f18-60aa-4673-8e27-4a8df62a0fa9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:58.818639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:58.819732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:58.820699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 275/544] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:47:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:58.828292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa40c2d-f59c-44bd-a7f1-07d918ad6885 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:58.976619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa40c2d-f59c-44bd-a7f1-07d918ad6885 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:59.039503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394ad68-be96-403b-a34e-62815789fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:59.043143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394ad68-be96-403b-a34e-62815789fea2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:59.043627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394ad68-be96-403b-a34e-62815789fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:59.044116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394ad68-be96-403b-a34e-62815789fea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:59.045305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394ad68-be96-403b-a34e-62815789fea2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:59.045783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394ad68-be96-403b-a34e-62815789fea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:59.047365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394ad68-be96-403b-a34e-62815789fea2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:59.062208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 270/545] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:47:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:59.068178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88356f18-60aa-4673-8e27-4a8df62a0fa9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:59.211571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88356f18-60aa-4673-8e27-4a8df62a0fa9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:59.239994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:59.264594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea81645-66f6-44ed-8a48-727f80625bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:59.265470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea81645-66f6-44ed-8a48-727f80625bdc None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:59.265760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea81645-66f6-44ed-8a48-727f80625bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:59.266037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea81645-66f6-44ed-8a48-727f80625bdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:59.283763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea81645-66f6-44ed-8a48-727f80625bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:59.285265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea81645-66f6-44ed-8a48-727f80625bdc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-dea81645-66f6-44ed-8a48-727f80625bdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:47:59.312835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:59.313867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:59.315129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:47:59.315129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:47:59.315129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:47:59.315129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:59.317496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 276/546] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:47:59.322989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394ad68-be96-403b-a34e-62815789fea2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:59.354869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a290d-081b-48bb-a1ea-c84d7bc14660 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:59.356264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a290d-081b-48bb-a1ea-c84d7bc14660 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:59.356843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a290d-081b-48bb-a1ea-c84d7bc14660 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:59.358615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 277/547] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:47:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:47:59.366418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41164c-37b1-4eca-a06d-b22aebb0d619 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:59.367064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41164c-37b1-4eca-a06d-b22aebb0d619 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:59.367550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41164c-37b1-4eca-a06d-b22aebb0d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:59.398706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-cb41164c-37b1-4eca-a06d-b22aebb0d619 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:47:59.400447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cb41164c-37b1-4eca-a06d-b22aebb0d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:47:59.417019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:59.506242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394ad68-be96-403b-a34e-62815789fea2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:59.536981 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 278/548] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:47:59.558394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467e10a-d97c-43f9-b82e-f2031f168ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:59.559038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467e10a-d97c-43f9-b82e-f2031f168ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:59.559315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467e10a-d97c-43f9-b82e-f2031f168ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:59.559575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467e10a-d97c-43f9-b82e-f2031f168ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:59.560278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467e10a-d97c-43f9-b82e-f2031f168ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:47:59.560845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467e10a-d97c-43f9-b82e-f2031f168ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:59.562249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467e10a-d97c-43f9-b82e-f2031f168ed0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:59.584641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 271/549] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:47:59.588449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41164c-37b1-4eca-a06d-b22aebb0d619 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:59.596915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467e10a-d97c-43f9-b82e-f2031f168ed0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:59.777450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467e10a-d97c-43f9-b82e-f2031f168ed0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:59.796773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:59.816588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff98b5-4c71-4a22-928c-9ed1d9f75dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:59.817647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff98b5-4c71-4a22-928c-9ed1d9f75dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:59.818134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff98b5-4c71-4a22-928c-9ed1d9f75dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:59.818624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff98b5-4c71-4a22-928c-9ed1d9f75dd7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:59.826867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff98b5-4c71-4a22-928c-9ed1d9f75dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:47:59.827624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41164c-37b1-4eca-a06d-b22aebb0d619 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:47:59.829114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff98b5-4c71-4a22-928c-9ed1d9f75dd7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:47:59.833839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4aff98b5-4c71-4a22-928c-9ed1d9f75dd7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:47:59.845477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:59.846430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:47:59.847356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:47:59.849909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 272/550] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:47:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:59.857998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff98b5-4c71-4a22-928c-9ed1d9f75dd7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:59.941531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb1393-a18f-4632-a735-96d750b6bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:47:59.942314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb1393-a18f-4632-a735-96d750b6bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:47:59.942594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb1393-a18f-4632-a735-96d750b6bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:47:59.942866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb1393-a18f-4632-a735-96d750b6bbe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:47:59.973392 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb1393-a18f-4632-a735-96d750b6bbe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-8bdb1393-a18f-4632-a735-96d750b6bbe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:47:59.982644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:47:59.983588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:47:59.984408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 279/551] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:47:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:47:59.990215 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb1393-a18f-4632-a735-96d750b6bbe0 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:47:59.998759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff98b5-4c71-4a22-928c-9ed1d9f75dd7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.061204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124d522-0db8-4154-95b0-6af8945c3ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:00.061824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124d522-0db8-4154-95b0-6af8945c3ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.062104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124d522-0db8-4154-95b0-6af8945c3ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.062377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124d522-0db8-4154-95b0-6af8945c3ad4 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.063327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124d522-0db8-4154-95b0-6af8945c3ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:00.063636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124d522-0db8-4154-95b0-6af8945c3ad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:00.065874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124d522-0db8-4154-95b0-6af8945c3ad4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:00.085993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 273/552] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 28 17:47:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:00.091452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eea50-4a35-4e6b-9f50-52ff252b914c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.091452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eea50-4a35-4e6b-9f50-52ff252b914c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.091452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eea50-4a35-4e6b-9f50-52ff252b914c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.093441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 274/553] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:00.094019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eea50-4a35-4e6b-9f50-52ff252b914c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:00.133403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.134598 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb1393-a18f-4632-a735-96d750b6bbe0 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.171613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af946f0-33aa-4ee6-9f44-977864ecbec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:00.172442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af946f0-33aa-4ee6-9f44-977864ecbec4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.173489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af946f0-33aa-4ee6-9f44-977864ecbec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.173959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af946f0-33aa-4ee6-9f44-977864ecbec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.174855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af946f0-33aa-4ee6-9f44-977864ecbec4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:00.175389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af946f0-33aa-4ee6-9f44-977864ecbec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:00.177012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af946f0-33aa-4ee6-9f44-977864ecbec4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:00.186422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 280/554] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:47:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:00.187905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465871-772b-475f-8de4-9b5ba79f16ce None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.188375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465871-772b-475f-8de4-9b5ba79f16ce None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.188984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465871-772b-475f-8de4-9b5ba79f16ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.207917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-4e465871-772b-475f-8de4-9b5ba79f16ce None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:00.209441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4e465871-772b-475f-8de4-9b5ba79f16ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:00.222302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eea50-4a35-4e6b-9f50-52ff252b914c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.232463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.260270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ea32f-c30f-4c66-80a6-417b1c9160ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:00.261289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ea32f-c30f-4c66-80a6-417b1c9160ea None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.261771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ea32f-c30f-4c66-80a6-417b1c9160ea None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.262233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ea32f-c30f-4c66-80a6-417b1c9160ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.288806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 281/555] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:00.288806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e465871-772b-475f-8de4-9b5ba79f16ce None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:00.368852 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ea32f-c30f-4c66-80a6-417b1c9160ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:00.370666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ea32f-c30f-4c66-80a6-417b1c9160ea None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:00.389086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e465871-772b-475f-8de4-9b5ba79f16ce None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.408672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.433576 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cfc31-aed2-4acd-b78d-f5c9e27129e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:00.434235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cfc31-aed2-4acd-b78d-f5c9e27129e8 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.434519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cfc31-aed2-4acd-b78d-f5c9e27129e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.434795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cfc31-aed2-4acd-b78d-f5c9e27129e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.449649 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cfc31-aed2-4acd-b78d-f5c9e27129e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:00.451116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cfc31-aed2-4acd-b78d-f5c9e27129e8 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-672cfc31-aed2-4acd-b78d-f5c9e27129e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:00.470563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:00.471484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:00.472631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:00.472631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:00.472631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:00.472631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:00.472631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 282/556] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:00.472631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cfc31-aed2-4acd-b78d-f5c9e27129e8 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:00.483977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.488624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 275/557] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:00.499092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d14b47-9758-4c39-9280-03f5113ece1f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.499092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d14b47-9758-4c39-9280-03f5113ece1f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.499092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d14b47-9758-4c39-9280-03f5113ece1f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.499092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 276/558] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:00.499092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d14b47-9758-4c39-9280-03f5113ece1f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:00.602446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cfc31-aed2-4acd-b78d-f5c9e27129e8 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.602680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d14b47-9758-4c39-9280-03f5113ece1f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.636202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8644d97-d65d-41de-83e2-c7a0184cc79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:00.636415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe25a3-dc64-42a9-b45f-c30ec644af3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:00.636893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8644d97-d65d-41de-83e2-c7a0184cc79e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.637020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe25a3-dc64-42a9-b45f-c30ec644af3d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.637176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8644d97-d65d-41de-83e2-c7a0184cc79e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.637299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe25a3-dc64-42a9-b45f-c30ec644af3d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.637447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8644d97-d65d-41de-83e2-c7a0184cc79e None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.637568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe25a3-dc64-42a9-b45f-c30ec644af3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.638130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8644d97-d65d-41de-83e2-c7a0184cc79e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:00.638432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8644d97-d65d-41de-83e2-c7a0184cc79e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:00.639875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8644d97-d65d-41de-83e2-c7a0184cc79e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:00.642793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.648231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe25a3-dc64-42a9-b45f-c30ec644af3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:00.658299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 277/559] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:00.658299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8644d97-d65d-41de-83e2-c7a0184cc79e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-03fe25a3-dc64-42a9-b45f-c30ec644af3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:00.658587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:00.659667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 283/560] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:00.660727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977beff7-9bc5-43ce-8dd7-0d78c955e474 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.661688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977beff7-9bc5-43ce-8dd7-0d78c955e474 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.661688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977beff7-9bc5-43ce-8dd7-0d78c955e474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.674531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-977beff7-9bc5-43ce-8dd7-0d78c955e474 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:00.675770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-977beff7-9bc5-43ce-8dd7-0d78c955e474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:00.737087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.742864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 284/561] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:00.744096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a018-fb39-4bc0-98e5-7ecb2240d01f None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.744372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a018-fb39-4bc0-98e5-7ecb2240d01f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.744639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a018-fb39-4bc0-98e5-7ecb2240d01f None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.746008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 285/562] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:00.751834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a018-fb39-4bc0-98e5-7ecb2240d01f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:00.788493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8644d97-d65d-41de-83e2-c7a0184cc79e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.829077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818e960-087f-4662-9d62-e529f8fba3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:00.829896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818e960-087f-4662-9d62-e529f8fba3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.830430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818e960-087f-4662-9d62-e529f8fba3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.830430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818e960-087f-4662-9d62-e529f8fba3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.842411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818e960-087f-4662-9d62-e529f8fba3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:00.843841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818e960-087f-4662-9d62-e529f8fba3e6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:00.854801 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a018-fb39-4bc0-98e5-7ecb2240d01f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5818e960-087f-4662-9d62-e529f8fba3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:00.858192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:00.859180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:00.860079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:00.860079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:00.860079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:00.860079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:00.860079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 278/563] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:00.860079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818e960-087f-4662-9d62-e529f8fba3e6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:00.892027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c7064-ec45-4fdd-bdfb-85d902d44798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:00.892588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c7064-ec45-4fdd-bdfb-85d902d44798 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.892905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c7064-ec45-4fdd-bdfb-85d902d44798 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.893179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c7064-ec45-4fdd-bdfb-85d902d44798 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.900156 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c7064-ec45-4fdd-bdfb-85d902d44798 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:00.901643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c7064-ec45-4fdd-bdfb-85d902d44798 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:00.911779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-795c7064-ec45-4fdd-bdfb-85d902d44798 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:00.913267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:00.914312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:00.915691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 286/564] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 28 17:48:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:00.916447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4530e-2162-480c-8713-f7ddb6be5298 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:00.916447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4530e-2162-480c-8713-f7ddb6be5298 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:00.916447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4530e-2162-480c-8713-f7ddb6be5298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:00.934022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ffe4530e-2162-480c-8713-f7ddb6be5298 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:00.935230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ffe4530e-2162-480c-8713-f7ddb6be5298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:00.966535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818e960-087f-4662-9d62-e529f8fba3e6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:00.987371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:00.999513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f494778-e3ab-4ee3-8799-d4c269a5b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.000317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f494778-e3ab-4ee3-8799-d4c269a5b52d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.000592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f494778-e3ab-4ee3-8799-d4c269a5b52d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.000892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f494778-e3ab-4ee3-8799-d4c269a5b52d None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.001493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 287/565] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:01.001651 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f494778-e3ab-4ee3-8799-d4c269a5b52d None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:01.001952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f494778-e3ab-4ee3-8799-d4c269a5b52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.002294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4530e-2162-480c-8713-f7ddb6be5298 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.003298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f494778-e3ab-4ee3-8799-d4c269a5b52d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.015989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 279/566] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:01.015989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f494778-e3ab-4ee3-8799-d4c269a5b52d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.106599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4530e-2162-480c-8713-f7ddb6be5298 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.114082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f494778-e3ab-4ee3-8799-d4c269a5b52d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.124143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:01.146098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4f70-c957-428b-a00e-8f57e2f90741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.146664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4f70-c957-428b-a00e-8f57e2f90741 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.146989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4f70-c957-428b-a00e-8f57e2f90741 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.150861 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a4f70-c957-428b-a00e-8f57e2f90741 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.151012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e08f83-7063-4180-be54-978948d44fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.151012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e08f83-7063-4180-be54-978948d44fbb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.151012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e08f83-7063-4180-be54-978948d44fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.151012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e08f83-7063-4180-be54-978948d44fbb None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.151351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e08f83-7063-4180-be54-978948d44fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:01.151351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e08f83-7063-4180-be54-978948d44fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.151499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e08f83-7063-4180-be54-978948d44fbb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.160243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a4f70-c957-428b-a00e-8f57e2f90741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:01.164875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 280/567] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:01.165536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e08f83-7063-4180-be54-978948d44fbb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-7b5a4f70-c957-428b-a00e-8f57e2f90741 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:01.167863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:01.168824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:01.169860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:01.174553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 288/568] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:01.175402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4f70-c957-428b-a00e-8f57e2f90741 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.226789 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:01.271896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e08f83-7063-4180-be54-978948d44fbb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.275597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a4f70-c957-428b-a00e-8f57e2f90741 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.306464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c1a5-2155-4ce8-95e5-3d5fde4d68eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.307073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c1a5-2155-4ce8-95e5-3d5fde4d68eb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.307349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c1a5-2155-4ce8-95e5-3d5fde4d68eb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.307622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c1a5-2155-4ce8-95e5-3d5fde4d68eb None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.308406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c1a5-2155-4ce8-95e5-3d5fde4d68eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:01.308707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c1a5-2155-4ce8-95e5-3d5fde4d68eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.309521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220e5ba-7941-483e-b093-f3ab17d2e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.310163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c1a5-2155-4ce8-95e5-3d5fde4d68eb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.310263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220e5ba-7941-483e-b093-f3ab17d2e3ee None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.310445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220e5ba-7941-483e-b093-f3ab17d2e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.310982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220e5ba-7941-483e-b093-f3ab17d2e3ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.321464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220e5ba-7941-483e-b093-f3ab17d2e3ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.322897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220e5ba-7941-483e-b093-f3ab17d2e3ee None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.328143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 281/569] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:01.328876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c1a5-2155-4ce8-95e5-3d5fde4d68eb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-2220e5ba-7941-483e-b093-f3ab17d2e3ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:01.340639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:01.341809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:01.342909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:01.342909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:01.342909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:01.342909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:01.342909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 289/570] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:01.342909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220e5ba-7941-483e-b093-f3ab17d2e3ee None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.362584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:01.432807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c1a5-2155-4ce8-95e5-3d5fde4d68eb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.440415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:01.443529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220e5ba-7941-483e-b093-f3ab17d2e3ee None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.466423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889175-9a09-4398-b391-1fa20c857924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.467060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889175-9a09-4398-b391-1fa20c857924 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.467339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889175-9a09-4398-b391-1fa20c857924 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.467609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889175-9a09-4398-b391-1fa20c857924 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.476835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc91a1-1c1c-40c2-9061-b639d59a25ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.477484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc91a1-1c1c-40c2-9061-b639d59a25ce None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.477766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc91a1-1c1c-40c2-9061-b639d59a25ce None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.478043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc91a1-1c1c-40c2-9061-b639d59a25ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.484714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc91a1-1c1c-40c2-9061-b639d59a25ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.486701 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc91a1-1c1c-40c2-9061-b639d59a25ce None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-11fc91a1-1c1c-40c2-9061-b639d59a25ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:01.500871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:01.502812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 290/571] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:01.504718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc91a1-1c1c-40c2-9061-b639d59a25ce None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.506952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d889175-9a09-4398-b391-1fa20c857924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9d889175-9a09-4398-b391-1fa20c857924 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:01.512269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:01.513462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:01.514599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:01.519889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 282/572] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:01.519889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889175-9a09-4398-b391-1fa20c857924 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.607499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc91a1-1c1c-40c2-9061-b639d59a25ce None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.608614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:01.620117 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889175-9a09-4398-b391-1fa20c857924 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.640936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27810-9a44-4b9f-9844-0398c151f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.641546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27810-9a44-4b9f-9844-0398c151f266 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.642339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27810-9a44-4b9f-9844-0398c151f266 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.642619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa27810-9a44-4b9f-9844-0398c151f266 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.643328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27810-9a44-4b9f-9844-0398c151f266 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:01.643631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27810-9a44-4b9f-9844-0398c151f266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.645021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa27810-9a44-4b9f-9844-0398c151f266 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.652844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 291/573] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:01.653622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27810-9a44-4b9f-9844-0398c151f266 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.658681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918a3d8-82fd-4b93-8abd-0d98fcf68b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.659314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918a3d8-82fd-4b93-8abd-0d98fcf68b40 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.659589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918a3d8-82fd-4b93-8abd-0d98fcf68b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.659881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918a3d8-82fd-4b93-8abd-0d98fcf68b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.670632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918a3d8-82fd-4b93-8abd-0d98fcf68b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.672080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918a3d8-82fd-4b93-8abd-0d98fcf68b40 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.678430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1918a3d8-82fd-4b93-8abd-0d98fcf68b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:01.687623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:01.688702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:01.689971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:01.689971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:01.689971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:01.689971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:01.689971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 283/574] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:01.689971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918a3d8-82fd-4b93-8abd-0d98fcf68b40 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.755269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa27810-9a44-4b9f-9844-0398c151f266 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.786929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918a3d8-82fd-4b93-8abd-0d98fcf68b40 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.788761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf47f-0aa3-4f40-86e4-9e3c2c405e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.789400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf47f-0aa3-4f40-86e4-9e3c2c405e0b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.789678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf47f-0aa3-4f40-86e4-9e3c2c405e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.789952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf47f-0aa3-4f40-86e4-9e3c2c405e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.790633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf47f-0aa3-4f40-86e4-9e3c2c405e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:01.790936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf47f-0aa3-4f40-86e4-9e3c2c405e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.792296 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf47f-0aa3-4f40-86e4-9e3c2c405e0b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.804291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 292/575] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:01.805094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf47f-0aa3-4f40-86e4-9e3c2c405e0b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.822792 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7273365-cb1c-498b-856e-6de6492bbb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.823400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7273365-cb1c-498b-856e-6de6492bbb14 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.823677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7273365-cb1c-498b-856e-6de6492bbb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.823949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7273365-cb1c-498b-856e-6de6492bbb14 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.824688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7273365-cb1c-498b-856e-6de6492bbb14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:01.825023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7273365-cb1c-498b-856e-6de6492bbb14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.826432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7273365-cb1c-498b-856e-6de6492bbb14 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.835217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:01.838474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 284/576] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:01.839246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7273365-cb1c-498b-856e-6de6492bbb14 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.887855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:01.908012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf47f-0aa3-4f40-86e4-9e3c2c405e0b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.934248 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7273365-cb1c-498b-856e-6de6492bbb14 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:01.941683 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aa4a1-55ad-4fd8-b50e-60ee7246ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.942239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aa4a1-55ad-4fd8-b50e-60ee7246ea39 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.942520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aa4a1-55ad-4fd8-b50e-60ee7246ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.942794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aa4a1-55ad-4fd8-b50e-60ee7246ea39 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.943620 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56aa4a1-55ad-4fd8-b50e-60ee7246ea39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:01.943926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56aa4a1-55ad-4fd8-b50e-60ee7246ea39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.945329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56aa4a1-55ad-4fd8-b50e-60ee7246ea39 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.954672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 293/577] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:01.954962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aa4a1-55ad-4fd8-b50e-60ee7246ea39 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:01.969145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fca3f-7e3b-4919-8c9f-0e71cfafb099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:01.969782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fca3f-7e3b-4919-8c9f-0e71cfafb099 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:01.970579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fca3f-7e3b-4919-8c9f-0e71cfafb099 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:01.970857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fca3f-7e3b-4919-8c9f-0e71cfafb099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:01.980777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fca3f-7e3b-4919-8c9f-0e71cfafb099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:01.982431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fca3f-7e3b-4919-8c9f-0e71cfafb099 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2b8fca3f-7e3b-4919-8c9f-0e71cfafb099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:01.997783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:01.998840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:01.999953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:01.999953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:01.999953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:01.999953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:02.000917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 285/578] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:02.002357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fca3f-7e3b-4919-8c9f-0e71cfafb099 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.053068 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:02.053638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aa4a1-55ad-4fd8-b50e-60ee7246ea39 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.087345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f311a3-843f-45aa-836f-438be39a516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.087957 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f311a3-843f-45aa-836f-438be39a516f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.088243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f311a3-843f-45aa-836f-438be39a516f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.088511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f311a3-843f-45aa-836f-438be39a516f None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.089223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f311a3-843f-45aa-836f-438be39a516f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:02.089526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f311a3-843f-45aa-836f-438be39a516f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.090936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f311a3-843f-45aa-836f-438be39a516f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.099028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fca3f-7e3b-4919-8c9f-0e71cfafb099 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.103893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 294/579] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:02.105327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f311a3-843f-45aa-836f-438be39a516f None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.108822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:02.132934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4ba7-d992-475a-b617-4b2aa10bf8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.133566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4ba7-d992-475a-b617-4b2aa10bf8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.133846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4ba7-d992-475a-b617-4b2aa10bf8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.134118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4ba7-d992-475a-b617-4b2aa10bf8c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.142867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf4ba7-d992-475a-b617-4b2aa10bf8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.144682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf4ba7-d992-475a-b617-4b2aa10bf8c4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-21bf4ba7-d992-475a-b617-4b2aa10bf8c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:02.156244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:02.157479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 286/580] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:02.158652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4ba7-d992-475a-b617-4b2aa10bf8c4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.208737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f311a3-843f-45aa-836f-438be39a516f None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.241995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66e99-ad01-41da-893c-3b78205c2e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.242719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66e99-ad01-41da-893c-3b78205c2e25 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.243104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66e99-ad01-41da-893c-3b78205c2e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.243498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66e99-ad01-41da-893c-3b78205c2e25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.244382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c66e99-ad01-41da-893c-3b78205c2e25 None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=38bd83f5a0bc4e7ea5cde1972c44503b) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:02.244820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c66e99-ad01-41da-893c-3b78205c2e25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.246414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c66e99-ad01-41da-893c-3b78205c2e25 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.251926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 295/581] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/role_assignments?user.id=38bd83f5a0bc4e7ea5cde1972c44503b&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:02.252711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66e99-ad01-41da-893c-3b78205c2e25 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.269709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4ba7-d992-475a-b617-4b2aa10bf8c4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.284284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:02.308588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad28a-07eb-4683-a809-a4a7218776f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.309468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad28a-07eb-4683-a809-a4a7218776f2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.309884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad28a-07eb-4683-a809-a4a7218776f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.310200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad28a-07eb-4683-a809-a4a7218776f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.323158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ad28a-07eb-4683-a809-a4a7218776f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.324813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ad28a-07eb-4683-a809-a4a7218776f2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.329474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-615ad28a-07eb-4683-a809-a4a7218776f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:02.340323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:02.341535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:02.342670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:02.342670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:02.342670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:02.342670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:02.343597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 287/582] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:02.345610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad28a-07eb-4683-a809-a4a7218776f2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.375899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66e99-ad01-41da-893c-3b78205c2e25 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.421154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283894bb-52cc-4bd4-9816-1acdf46f3b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.421793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283894bb-52cc-4bd4-9816-1acdf46f3b70 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.422060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283894bb-52cc-4bd4-9816-1acdf46f3b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.422332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283894bb-52cc-4bd4-9816-1acdf46f3b70 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.423552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283894bb-52cc-4bd4-9816-1acdf46f3b70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:02.423860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283894bb-52cc-4bd4-9816-1acdf46f3b70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.425398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283894bb-52cc-4bd4-9816-1acdf46f3b70 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.442702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 296/583] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:02.443593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283894bb-52cc-4bd4-9816-1acdf46f3b70 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.452379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ad28a-07eb-4683-a809-a4a7218776f2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.488104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8d0ee-205c-4954-ba39-c78cfa67785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.488638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8d0ee-205c-4954-ba39-c78cfa67785f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.488960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8d0ee-205c-4954-ba39-c78cfa67785f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.489238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8d0ee-205c-4954-ba39-c78cfa67785f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.496368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8d0ee-205c-4954-ba39-c78cfa67785f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.497840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8d0ee-205c-4954-ba39-c78cfa67785f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-49f8d0ee-205c-4954-ba39-c78cfa67785f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:02.509306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:02.510400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:02.511515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:02.511515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:02.511515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:02.511515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:02.511515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:02.511515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:02.511515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:02.511515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:02.512215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 288/584] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:02.517478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8d0ee-205c-4954-ba39-c78cfa67785f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.549706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:02.559160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283894bb-52cc-4bd4-9816-1acdf46f3b70 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.590220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:02.599287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058983-a629-4d07-9c0f-5bfe8a195a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.599993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058983-a629-4d07-9c0f-5bfe8a195a94 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.600328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058983-a629-4d07-9c0f-5bfe8a195a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.600653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058983-a629-4d07-9c0f-5bfe8a195a94 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.601538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3058983-a629-4d07-9c0f-5bfe8a195a94 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:02.602217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3058983-a629-4d07-9c0f-5bfe8a195a94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.603481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3058983-a629-4d07-9c0f-5bfe8a195a94 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.627568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 297/585] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:02.628522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058983-a629-4d07-9c0f-5bfe8a195a94 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.634678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8d0ee-205c-4954-ba39-c78cfa67785f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.670012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7418233-04a2-49f7-9aea-12f58e6c207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.670735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7418233-04a2-49f7-9aea-12f58e6c207b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.671097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7418233-04a2-49f7-9aea-12f58e6c207b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.671410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7418233-04a2-49f7-9aea-12f58e6c207b None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.672099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7418233-04a2-49f7-9aea-12f58e6c207b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:02.672398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7418233-04a2-49f7-9aea-12f58e6c207b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.674344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7418233-04a2-49f7-9aea-12f58e6c207b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.687136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 289/586] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:02.689661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7418233-04a2-49f7-9aea-12f58e6c207b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.731835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058983-a629-4d07-9c0f-5bfe8a195a94 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.767609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cfd4b-cee7-4542-97cb-eeeaec9cb594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.768307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cfd4b-cee7-4542-97cb-eeeaec9cb594 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.768683 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cfd4b-cee7-4542-97cb-eeeaec9cb594 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.769084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cfd4b-cee7-4542-97cb-eeeaec9cb594 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.776221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cfd4b-cee7-4542-97cb-eeeaec9cb594 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.777812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cfd4b-cee7-4542-97cb-eeeaec9cb594 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.780840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-662cfd4b-cee7-4542-97cb-eeeaec9cb594 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:02.790529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:02.797288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 298/587] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:02.798543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cfd4b-cee7-4542-97cb-eeeaec9cb594 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.807566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7418233-04a2-49f7-9aea-12f58e6c207b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.843845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371e61c-f99f-427a-829a-3db8a7ea0117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.844484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371e61c-f99f-427a-829a-3db8a7ea0117 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.844726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371e61c-f99f-427a-829a-3db8a7ea0117 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.845554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371e61c-f99f-427a-829a-3db8a7ea0117 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.846308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371e61c-f99f-427a-829a-3db8a7ea0117 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:02.846612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371e61c-f99f-427a-829a-3db8a7ea0117 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.848036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371e61c-f99f-427a-829a-3db8a7ea0117 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.849021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:02.860568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 290/588] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:02.862053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371e61c-f99f-427a-829a-3db8a7ea0117 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:02.915463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cfd4b-cee7-4542-97cb-eeeaec9cb594 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.953037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115bae5-21c4-4c0c-a1a8-39220c93ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:02.953743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115bae5-21c4-4c0c-a1a8-39220c93ae60 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:02.954028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115bae5-21c4-4c0c-a1a8-39220c93ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:02.954852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115bae5-21c4-4c0c-a1a8-39220c93ae60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:02.966726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115bae5-21c4-4c0c-a1a8-39220c93ae60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:02.968415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115bae5-21c4-4c0c-a1a8-39220c93ae60 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:02.970610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371e61c-f99f-427a-829a-3db8a7ea0117 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-a115bae5-21c4-4c0c-a1a8-39220c93ae60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:02.983119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:02.984056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:02.985112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:02.985112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:02.985112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:02.985112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:02.988931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 299/589] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:02.990161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115bae5-21c4-4c0c-a1a8-39220c93ae60 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.009837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663fdfa-d1aa-4e0b-8c5e-879bf6bbc371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.010478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663fdfa-d1aa-4e0b-8c5e-879bf6bbc371 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.010760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663fdfa-d1aa-4e0b-8c5e-879bf6bbc371 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.011037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663fdfa-d1aa-4e0b-8c5e-879bf6bbc371 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.019380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663fdfa-d1aa-4e0b-8c5e-879bf6bbc371 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.020757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663fdfa-d1aa-4e0b-8c5e-879bf6bbc371 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0663fdfa-d1aa-4e0b-8c5e-879bf6bbc371 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:03.032005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:03.033087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:48:03.034066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:03.037898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 291/590] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:03.038496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663fdfa-d1aa-4e0b-8c5e-879bf6bbc371 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.042641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.093525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.097524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115bae5-21c4-4c0c-a1a8-39220c93ae60 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.133618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df3620-8068-4f8c-9230-03a32c842b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.134714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df3620-8068-4f8c-9230-03a32c842b80 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.135614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df3620-8068-4f8c-9230-03a32c842b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.135941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df3620-8068-4f8c-9230-03a32c842b80 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.136796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df3620-8068-4f8c-9230-03a32c842b80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:03.137115 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df3620-8068-4f8c-9230-03a32c842b80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.138553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df3620-8068-4f8c-9230-03a32c842b80 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.140868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663fdfa-d1aa-4e0b-8c5e-879bf6bbc371 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.156846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 300/591] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 28 17:48:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:03.157708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df3620-8068-4f8c-9230-03a32c842b80 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.187007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeb10c-07c5-4a44-a942-c668ef27531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.187804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeb10c-07c5-4a44-a942-c668ef27531a None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.188181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeb10c-07c5-4a44-a942-c668ef27531a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.188460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeb10c-07c5-4a44-a942-c668ef27531a None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/cb85b3e1dc464438ac007c1b09ea7fd3/roles/467b18ae24a4482592d2b45bc717c5eb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.204976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeb10c-07c5-4a44-a942-c668ef27531a None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=cb85b3e1dc464438ac007c1b09ea7fd3, role_id=467b18ae24a4482592d2b45bc717c5eb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.206588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeb10c-07c5-4a44-a942-c668ef27531a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.258306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df3620-8068-4f8c-9230-03a32c842b80 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.291791 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63122ea-a544-4223-ab47-f4603be2841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.292406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63122ea-a544-4223-ab47-f4603be2841f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.292688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63122ea-a544-4223-ab47-f4603be2841f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.292987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63122ea-a544-4223-ab47-f4603be2841f None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.293677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63122ea-a544-4223-ab47-f4603be2841f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:03.293980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63122ea-a544-4223-ab47-f4603be2841f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.295355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63122ea-a544-4223-ab47-f4603be2841f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.300819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 292/592] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:03 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/cb85b3e1dc464438ac007c1b09ea7fd3/roles/467b18ae24a4482592d2b45bc717c5eb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:03.308239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 301/593] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:03.309078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63122ea-a544-4223-ab47-f4603be2841f None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.309434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeb10c-07c5-4a44-a942-c668ef27531a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.329030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.416672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.437358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63122ea-a544-4223-ab47-f4603be2841f None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.477143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeb10c-07c5-4a44-a942-c668ef27531a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.493278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53efd7-a918-4cf8-b01d-4e8185b39c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.494545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53efd7-a918-4cf8-b01d-4e8185b39c2d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.495271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53efd7-a918-4cf8-b01d-4e8185b39c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.495713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53efd7-a918-4cf8-b01d-4e8185b39c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.513932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53efd7-a918-4cf8-b01d-4e8185b39c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.516286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53efd7-a918-4cf8-b01d-4e8185b39c2d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.526726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f19df-0477-4040-ad0d-10d1bac3f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.528355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f19df-0477-4040-ad0d-10d1bac3f507 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.528355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f19df-0477-4040-ad0d-10d1bac3f507 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.528355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f19df-0477-4040-ad0d-10d1bac3f507 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.529357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f19df-0477-4040-ad0d-10d1bac3f507 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:03.529778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f19df-0477-4040-ad0d-10d1bac3f507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.531432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f19df-0477-4040-ad0d-10d1bac3f507 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-cc53efd7-a918-4cf8-b01d-4e8185b39c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:03.533572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:03.534596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:03.535712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:03.535712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:03.535712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:03.535712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:03.535712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 302/594] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:03.535712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53efd7-a918-4cf8-b01d-4e8185b39c2d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.562737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 293/595] 10.222.0.67 () {56 vars in 1139 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:03.562737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f19df-0477-4040-ad0d-10d1bac3f507 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.628093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.646357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53efd7-a918-4cf8-b01d-4e8185b39c2d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.689240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f19df-0477-4040-ad0d-10d1bac3f507 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.689446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8fb65-f498-42d1-b076-4f7784f93b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.690236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8fb65-f498-42d1-b076-4f7784f93b2a None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.690620 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8fb65-f498-42d1-b076-4f7784f93b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.690992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8fb65-f498-42d1-b076-4f7784f93b2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.702429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8fb65-f498-42d1-b076-4f7784f93b2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.704159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8fb65-f498-42d1-b076-4f7784f93b2a None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.709724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d2a8fb65-f498-42d1-b076-4f7784f93b2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:03.717193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:03.723760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 303/596] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:03.724656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8fb65-f498-42d1-b076-4f7784f93b2a None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.735340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5505b-f3a3-4067-bfdd-1e44007c932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.736829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5505b-f3a3-4067-bfdd-1e44007c932d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.737330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5505b-f3a3-4067-bfdd-1e44007c932d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.737805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5505b-f3a3-4067-bfdd-1e44007c932d None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.738998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5505b-f3a3-4067-bfdd-1e44007c932d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:03.739917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5505b-f3a3-4067-bfdd-1e44007c932d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.741534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5505b-f3a3-4067-bfdd-1e44007c932d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.754074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 294/597] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:03.755452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5505b-f3a3-4067-bfdd-1e44007c932d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.832515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8fb65-f498-42d1-b076-4f7784f93b2a None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.861325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:03.862646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5505b-f3a3-4067-bfdd-1e44007c932d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:03.870662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154066c3-7705-4975-8db7-37d8c7368617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.871648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154066c3-7705-4975-8db7-37d8c7368617 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.872097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154066c3-7705-4975-8db7-37d8c7368617 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.872537 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154066c3-7705-4975-8db7-37d8c7368617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.884765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154066c3-7705-4975-8db7-37d8c7368617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.886720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154066c3-7705-4975-8db7-37d8c7368617 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.902740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505abf5a-7536-48f4-9425-031d1b319c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:03.903470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505abf5a-7536-48f4-9425-031d1b319c61 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:03.903821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505abf5a-7536-48f4-9425-031d1b319c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:03.904169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505abf5a-7536-48f4-9425-031d1b319c61 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:03.905028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505abf5a-7536-48f4-9425-031d1b319c61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:03.905403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505abf5a-7536-48f4-9425-031d1b319c61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-154066c3-7705-4975-8db7-37d8c7368617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:03.906101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:03.907036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:03.907992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:03.907992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:03.907992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:03.907992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:03.908245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505abf5a-7536-48f4-9425-031d1b319c61 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:03.910293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 304/598] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:03.911281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154066c3-7705-4975-8db7-37d8c7368617 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.928390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 295/599] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:03.929624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505abf5a-7536-48f4-9425-031d1b319c61 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:03.971927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:04.033864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154066c3-7705-4975-8db7-37d8c7368617 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:04.054726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505abf5a-7536-48f4-9425-031d1b319c61 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:04.069899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b789c7-eef2-4e01-bd67-c80dbb3c5551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:04.070546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b789c7-eef2-4e01-bd67-c80dbb3c5551 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.070826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b789c7-eef2-4e01-bd67-c80dbb3c5551 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.071100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b789c7-eef2-4e01-bd67-c80dbb3c5551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.078333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b789c7-eef2-4e01-bd67-c80dbb3c5551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:04.079865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b789c7-eef2-4e01-bd67-c80dbb3c5551 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-a9b789c7-eef2-4e01-bd67-c80dbb3c5551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:04.091871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:04.092770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:04.093702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:04.093702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:04.093702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:04.093702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:04.093702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:04.093702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:04.093702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:04.093702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:04.093702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 305/600] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:04.094203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b789c7-eef2-4e01-bd67-c80dbb3c5551 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:04.098531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef773-c182-48fd-ad60-027bd1ea4cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:04.099399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef773-c182-48fd-ad60-027bd1ea4cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.099896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef773-c182-48fd-ad60-027bd1ea4cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.100387 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef773-c182-48fd-ad60-027bd1ea4cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.101311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ef773-c182-48fd-ad60-027bd1ea4cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:04.101832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ef773-c182-48fd-ad60-027bd1ea4cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:04.103411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ef773-c182-48fd-ad60-027bd1ea4cb2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:04.116463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 296/601] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:04.117711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef773-c182-48fd-ad60-027bd1ea4cb2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:04.141525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:04.215537 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b789c7-eef2-4e01-bd67-c80dbb3c5551 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:04.216589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:04.226891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef773-c182-48fd-ad60-027bd1ea4cb2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:04.252000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1d90e-3bc2-41e2-9c3f-21749c0dcf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:04.252651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1d90e-3bc2-41e2-9c3f-21749c0dcf36 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.252976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1d90e-3bc2-41e2-9c3f-21749c0dcf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.253252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1d90e-3bc2-41e2-9c3f-21749c0dcf36 None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/3a4c879f65c24edea2404cb74ac37025/roles/467b18ae24a4482592d2b45bc717c5eb` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.265302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec333-d16b-40a1-9ce9-8f5e2e9ac260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:04.266204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec333-d16b-40a1-9ce9-8f5e2e9ac260 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.266709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec333-d16b-40a1-9ce9-8f5e2e9ac260 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.267088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec333-d16b-40a1-9ce9-8f5e2e9ac260 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.268129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baec333-d16b-40a1-9ce9-8f5e2e9ac260 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:04.268504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baec333-d16b-40a1-9ce9-8f5e2e9ac260 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:04.268614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1d90e-3bc2-41e2-9c3f-21749c0dcf36 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=3a4c879f65c24edea2404cb74ac37025, role_id=467b18ae24a4482592d2b45bc717c5eb)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:04.270062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baec333-d16b-40a1-9ce9-8f5e2e9ac260 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:04.270179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1d90e-3bc2-41e2-9c3f-21749c0dcf36 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:04.282939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 297/602] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:04.290109 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec333-d16b-40a1-9ce9-8f5e2e9ac260 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:04.358586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 306/603] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:04 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/3a4c879f65c24edea2404cb74ac37025/roles/467b18ae24a4482592d2b45bc717c5eb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:04.360134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4afa0-f703-4984-b252-6fffa1f2ab83 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.360424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4afa0-f703-4984-b252-6fffa1f2ab83 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.360926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4afa0-f703-4984-b252-6fffa1f2ab83 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.362455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 307/604] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:04.367286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4afa0-f703-4984-b252-6fffa1f2ab83 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:04.403288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec333-d16b-40a1-9ce9-8f5e2e9ac260 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:04.446764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce152498-d73c-48d0-9b73-455c5aa2bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:04.447521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce152498-d73c-48d0-9b73-455c5aa2bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.447889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce152498-d73c-48d0-9b73-455c5aa2bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.448221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce152498-d73c-48d0-9b73-455c5aa2bc89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.456959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce152498-d73c-48d0-9b73-455c5aa2bc89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:04.458809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce152498-d73c-48d0-9b73-455c5aa2bc89 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ce152498-d73c-48d0-9b73-455c5aa2bc89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:04.471952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:04.472992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:04.473901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:04.473901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:04.473901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:04.473901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:04.473901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:04.473901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:04.473901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:04.473901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:04.473901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 298/605] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:04.475407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa8e5-4924-41e7-889a-ee554fddf9c4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.475750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa8e5-4924-41e7-889a-ee554fddf9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.476085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa8e5-4924-41e7-889a-ee554fddf9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.496110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9b2aa8e5-4924-41e7-889a-ee554fddf9c4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:04.497507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9b2aa8e5-4924-41e7-889a-ee554fddf9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:04.499385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:04.508295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:04.514941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4afa0-f703-4984-b252-6fffa1f2ab83 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:04.558527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fe51b-6373-43ca-9543-2df8b79805d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:04.559687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe51b-6373-43ca-9543-2df8b79805d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.560040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe51b-6373-43ca-9543-2df8b79805d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.560478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe51b-6373-43ca-9543-2df8b79805d9 None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/18138af1ea504faca84b0cc2034ddd36/roles/467b18ae24a4482592d2b45bc717c5eb` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.579681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 299/606] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:04.580644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2aa8e5-4924-41e7-889a-ee554fddf9c4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:04.586452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fe51b-6373-43ca-9543-2df8b79805d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=18138af1ea504faca84b0cc2034ddd36, role_id=467b18ae24a4482592d2b45bc717c5eb)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:04.588022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fe51b-6373-43ca-9543-2df8b79805d9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:04.686543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2aa8e5-4924-41e7-889a-ee554fddf9c4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:04.706539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 308/607] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:04 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/18138af1ea504faca84b0cc2034ddd36/roles/467b18ae24a4482592d2b45bc717c5eb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:04.712845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fe51b-6373-43ca-9543-2df8b79805d9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:04.753616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23ac69-20ff-4521-af81-5c1ad2de0d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:04.754260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23ac69-20ff-4521-af81-5c1ad2de0d42 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.754540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23ac69-20ff-4521-af81-5c1ad2de0d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.754812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23ac69-20ff-4521-af81-5c1ad2de0d42 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.755572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23ac69-20ff-4521-af81-5c1ad2de0d42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:04.755885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23ac69-20ff-4521-af81-5c1ad2de0d42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:04.757343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23ac69-20ff-4521-af81-5c1ad2de0d42 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:04.790098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 300/608] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:04.795662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23ac69-20ff-4521-af81-5c1ad2de0d42 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:04.799163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:04.883812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fe51b-6373-43ca-9543-2df8b79805d9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:04.929840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bd564-6a6b-449b-b95f-647f7a80116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:04.930946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bd564-6a6b-449b-b95f-647f7a80116b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:04.931331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bd564-6a6b-449b-b95f-647f7a80116b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:04.931730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bd564-6a6b-449b-b95f-647f7a80116b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:04.943050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:04.946761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bd564-6a6b-449b-b95f-647f7a80116b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-e32bd564-6a6b-449b-b95f-647f7a80116b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:04.952259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:04.961253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:04.962201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 309/609] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:04.962901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23ac69-20ff-4521-af81-5c1ad2de0d42 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:04.963303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bd564-6a6b-449b-b95f-647f7a80116b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:05.004741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bba66-7e06-4946-9afe-e7a79dd83ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:05.005926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bba66-7e06-4946-9afe-e7a79dd83ddb None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:05.006478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bba66-7e06-4946-9afe-e7a79dd83ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:05.007433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bba66-7e06-4946-9afe-e7a79dd83ddb None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/0116171a83f5444d91ce0ea2439a9bd2/roles/467b18ae24a4482592d2b45bc717c5eb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:05.027284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bba66-7e06-4946-9afe-e7a79dd83ddb None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=0116171a83f5444d91ce0ea2439a9bd2, role_id=467b18ae24a4482592d2b45bc717c5eb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:05.029258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bba66-7e06-4946-9afe-e7a79dd83ddb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:05.082172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bd564-6a6b-449b-b95f-647f7a80116b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:05.122894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf839f-eddc-4cb3-9c2c-79036ca78a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:05.123536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf839f-eddc-4cb3-9c2c-79036ca78a45 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:05.124840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf839f-eddc-4cb3-9c2c-79036ca78a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:05.124840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf839f-eddc-4cb3-9c2c-79036ca78a45 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:05.124840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf839f-eddc-4cb3-9c2c-79036ca78a45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:05.125202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf839f-eddc-4cb3-9c2c-79036ca78a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:05.126825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf839f-eddc-4cb3-9c2c-79036ca78a45 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:05.136495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 310/610] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:05.143997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 301/611] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:04 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/0116171a83f5444d91ce0ea2439a9bd2/roles/467b18ae24a4482592d2b45bc717c5eb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:48:05.146941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf839f-eddc-4cb3-9c2c-79036ca78a45 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:05.234249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:05.277272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf839f-eddc-4cb3-9c2c-79036ca78a45 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:05.323807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682b7fb-97e0-4876-97ad-b1cfe9863713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:05.324460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682b7fb-97e0-4876-97ad-b1cfe9863713 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:05.324809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682b7fb-97e0-4876-97ad-b1cfe9863713 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:05.325144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682b7fb-97e0-4876-97ad-b1cfe9863713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:05.344415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682b7fb-97e0-4876-97ad-b1cfe9863713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:05.345999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682b7fb-97e0-4876-97ad-b1cfe9863713 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-1682b7fb-97e0-4876-97ad-b1cfe9863713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:05.364096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:05.365085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:05.365976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:05.365976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:05.365976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:05.365976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:05.365976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 311/612] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:05.371487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bba66-7e06-4946-9afe-e7a79dd83ddb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:05.454999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:05.505318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bba66-7e06-4946-9afe-e7a79dd83ddb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:05.544314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0974a4-4956-448e-aed2-ae65b1e6d817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:05.545330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0974a4-4956-448e-aed2-ae65b1e6d817 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:05.545829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0974a4-4956-448e-aed2-ae65b1e6d817 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:05.546292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0974a4-4956-448e-aed2-ae65b1e6d817 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:05.547218 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0974a4-4956-448e-aed2-ae65b1e6d817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:05.547717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0974a4-4956-448e-aed2-ae65b1e6d817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:05.549364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0974a4-4956-448e-aed2-ae65b1e6d817 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:05.564241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 302/613] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:05.573890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682b7fb-97e0-4876-97ad-b1cfe9863713 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:05.630044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfb5f7-64b7-4784-887c-016ca5c13579 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:05.630694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfb5f7-64b7-4784-887c-016ca5c13579 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:05.631188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfb5f7-64b7-4784-887c-016ca5c13579 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:05.633316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 303/614] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:05.638571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0816a4-6efb-4cf6-a90e-f1a01602c434 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:05.638853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0816a4-6efb-4cf6-a90e-f1a01602c434 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:05.639126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0816a4-6efb-4cf6-a90e-f1a01602c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:05.671595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ac0816a4-6efb-4cf6-a90e-f1a01602c434 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:05.674009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ac0816a4-6efb-4cf6-a90e-f1a01602c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:05.734757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682b7fb-97e0-4876-97ad-b1cfe9863713 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:05.762786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:05.789930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b59aa9-057d-4f15-b63b-a1e67108c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:05.790580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59aa9-057d-4f15-b63b-a1e67108c725 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:05.790857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59aa9-057d-4f15-b63b-a1e67108c725 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:05.791131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59aa9-057d-4f15-b63b-a1e67108c725 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:05.802408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 304/615] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:48:05.803227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b59aa9-057d-4f15-b63b-a1e67108c725 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:05.804710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b59aa9-057d-4f15-b63b-a1e67108c725 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-73b59aa9-057d-4f15-b63b-a1e67108c725 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:05.817194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:05.818145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:05.819075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:05.823907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0816a4-6efb-4cf6-a90e-f1a01602c434 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:05.824404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 312/616] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:05.839515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b59aa9-057d-4f15-b63b-a1e67108c725 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:05.889822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.001808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0816a4-6efb-4cf6-a90e-f1a01602c434 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:06.023913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b59aa9-057d-4f15-b63b-a1e67108c725 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:06.042456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2bbe3-d9ab-480e-be42-5f47740d275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:06.043075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2bbe3-d9ab-480e-be42-5f47740d275c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.043353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2bbe3-d9ab-480e-be42-5f47740d275c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.043622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2bbe3-d9ab-480e-be42-5f47740d275c None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.044410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2bbe3-d9ab-480e-be42-5f47740d275c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:06.044715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2bbe3-d9ab-480e-be42-5f47740d275c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:06.046157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2bbe3-d9ab-480e-be42-5f47740d275c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:06.076153 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 305/617] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 28 17:48:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:06.082041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2bbe3-d9ab-480e-be42-5f47740d275c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:06.100638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321c41d-fe84-4828-a82a-d8262fad7ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:06.101586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321c41d-fe84-4828-a82a-d8262fad7ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.101864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321c41d-fe84-4828-a82a-d8262fad7ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.102391 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321c41d-fe84-4828-a82a-d8262fad7ad4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.125261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321c41d-fe84-4828-a82a-d8262fad7ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d321c41d-fe84-4828-a82a-d8262fad7ad4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:06.132520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:06.134818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:06.137014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 313/618] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:06.146630 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321c41d-fe84-4828-a82a-d8262fad7ad4 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:06.214851 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.265374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.269492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2bbe3-d9ab-480e-be42-5f47740d275c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:06.320040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321c41d-fe84-4828-a82a-d8262fad7ad4 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:06.360203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6fb13-14d4-4e0a-aa2e-e8a8af62c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:06.361261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6fb13-14d4-4e0a-aa2e-e8a8af62c6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.361746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6fb13-14d4-4e0a-aa2e-e8a8af62c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.362324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6fb13-14d4-4e0a-aa2e-e8a8af62c6e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.372802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f4560-95ad-4542-a3ab-f75e1d52b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:06.373280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f4560-95ad-4542-a3ab-f75e1d52b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.373569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f4560-95ad-4542-a3ab-f75e1d52b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.373848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f4560-95ad-4542-a3ab-f75e1d52b6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.374575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f4560-95ad-4542-a3ab-f75e1d52b6e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:06.374881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f4560-95ad-4542-a3ab-f75e1d52b6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:06.376806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f4560-95ad-4542-a3ab-f75e1d52b6e1 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:06.383050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6fb13-14d4-4e0a-aa2e-e8a8af62c6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:06.384725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6fb13-14d4-4e0a-aa2e-e8a8af62c6e1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:06.399256 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 314/619] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:06.404376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f4560-95ad-4542-a3ab-f75e1d52b6e1 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b5a6fb13-14d4-4e0a-aa2e-e8a8af62c6e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:06.410463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:06.411376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:06.412665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:06.412665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:06.412665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:06.412665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:06.412665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 306/620] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:06.417503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6fb13-14d4-4e0a-aa2e-e8a8af62c6e1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:06.562671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.570252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f4560-95ad-4542-a3ab-f75e1d52b6e1 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:06.575286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6fb13-14d4-4e0a-aa2e-e8a8af62c6e1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:06.610874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078737f-3795-4c86-880a-43d90e1e1e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:06.611533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078737f-3795-4c86-880a-43d90e1e1e46 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.611812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078737f-3795-4c86-880a-43d90e1e1e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.612086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078737f-3795-4c86-880a-43d90e1e1e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.624866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078737f-3795-4c86-880a-43d90e1e1e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:06.626691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078737f-3795-4c86-880a-43d90e1e1e46 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d078737f-3795-4c86-880a-43d90e1e1e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:06.643749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:06.644667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:06.646188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:06.646188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:06.646188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:06.646188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:06.646188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 315/621] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:06.651059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078737f-3795-4c86-880a-43d90e1e1e46 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:06.665227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8790-54fe-45c7-bf2c-0677ed6eae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:06.665862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8790-54fe-45c7-bf2c-0677ed6eae89 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.666190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8790-54fe-45c7-bf2c-0677ed6eae89 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.666469 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8790-54fe-45c7-bf2c-0677ed6eae89 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.667168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe8790-54fe-45c7-bf2c-0677ed6eae89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:06.667469 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe8790-54fe-45c7-bf2c-0677ed6eae89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:06.669475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe8790-54fe-45c7-bf2c-0677ed6eae89 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:06.683763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 307/622] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:06.690054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8790-54fe-45c7-bf2c-0677ed6eae89 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:06.711219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.795996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078737f-3795-4c86-880a-43d90e1e1e46 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:06.814079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8790-54fe-45c7-bf2c-0677ed6eae89 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:06.839696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce249c7d-440d-4a15-9e3f-d9d274c62b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:06.841206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce249c7d-440d-4a15-9e3f-d9d274c62b9e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.841989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce249c7d-440d-4a15-9e3f-d9d274c62b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.842487 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce249c7d-440d-4a15-9e3f-d9d274c62b9e None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.844042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce249c7d-440d-4a15-9e3f-d9d274c62b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:06.845386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce249c7d-440d-4a15-9e3f-d9d274c62b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:06.847631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce249c7d-440d-4a15-9e3f-d9d274c62b9e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:06.855395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db04421-0c1d-4c59-8877-992c62fd9fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:06.856037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db04421-0c1d-4c59-8877-992c62fd9fae None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.856316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db04421-0c1d-4c59-8877-992c62fd9fae None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.856588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db04421-0c1d-4c59-8877-992c62fd9fae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.863789 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 316/623] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:06.865121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db04421-0c1d-4c59-8877-992c62fd9fae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:06.865951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523056f2-4041-4237-b89e-b3670592a248 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.866435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523056f2-4041-4237-b89e-b3670592a248 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.866632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db04421-0c1d-4c59-8877-992c62fd9fae None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:06.867095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523056f2-4041-4237-b89e-b3670592a248 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.873300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 317/624] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:06.873821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523056f2-4041-4237-b89e-b3670592a248 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0db04421-0c1d-4c59-8877-992c62fd9fae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:06.886849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:06.887821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:06.889200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:06.889200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:06.889200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:06.889200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:06.889200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:06.889200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:06.889200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:06.889200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:06.889200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 308/625] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:06.894566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7530ed6-1b9a-4799-95ff-7a41ca009220 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:06.894874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7530ed6-1b9a-4799-95ff-7a41ca009220 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:06.895158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7530ed6-1b9a-4799-95ff-7a41ca009220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:06.906498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:06.919695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c7530ed6-1b9a-4799-95ff-7a41ca009220 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:06.926093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c7530ed6-1b9a-4799-95ff-7a41ca009220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:07.008096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 309/626] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:07.009735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7530ed6-1b9a-4799-95ff-7a41ca009220 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:07.024272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:07.026738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523056f2-4041-4237-b89e-b3670592a248 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:07.074774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b3b40-6be7-418a-ac1e-55fb5c27d9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:07.075510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b3b40-6be7-418a-ac1e-55fb5c27d9ab None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.075795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b3b40-6be7-418a-ac1e-55fb5c27d9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.076070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b3b40-6be7-418a-ac1e-55fb5c27d9ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.083743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b3b40-6be7-418a-ac1e-55fb5c27d9ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:07.085299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b3b40-6be7-418a-ac1e-55fb5c27d9ab None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-418b3b40-6be7-418a-ac1e-55fb5c27d9ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:07.098103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:07.099077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 318/627] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 28 17:48:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:07.100589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b3b40-6be7-418a-ac1e-55fb5c27d9ab None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:07.171450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7530ed6-1b9a-4799-95ff-7a41ca009220 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:07.179002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:07.218092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8d6ba-d92b-482d-8034-fe41fd4aec3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:07.218719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d6ba-d92b-482d-8034-fe41fd4aec3a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.218841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b3b40-6be7-418a-ac1e-55fb5c27d9ab None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:07.219011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d6ba-d92b-482d-8034-fe41fd4aec3a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.219261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d6ba-d92b-482d-8034-fe41fd4aec3a None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.220556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8d6ba-d92b-482d-8034-fe41fd4aec3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:07.221071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8d6ba-d92b-482d-8034-fe41fd4aec3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:07.222512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8d6ba-d92b-482d-8034-fe41fd4aec3a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:07.235087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 310/628] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:07.236712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8d6ba-d92b-482d-8034-fe41fd4aec3a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:07.260818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d38b5-8a1f-4767-87d9-3f1b8e63a4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:07.261743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d38b5-8a1f-4767-87d9-3f1b8e63a4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.262022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d38b5-8a1f-4767-87d9-3f1b8e63a4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.262302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d38b5-8a1f-4767-87d9-3f1b8e63a4d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.272713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d38b5-8a1f-4767-87d9-3f1b8e63a4d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-e95d38b5-8a1f-4767-87d9-3f1b8e63a4d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:07.278109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:07.279087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 319/629] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:07.285654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acacf3-1816-4732-83d3-0a4c0e5b9064 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.286446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acacf3-1816-4732-83d3-0a4c0e5b9064 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.286446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acacf3-1816-4732-83d3-0a4c0e5b9064 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.286446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 320/630] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:07.286446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acacf3-1816-4732-83d3-0a4c0e5b9064 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:07.309209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:07.347625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8d6ba-d92b-482d-8034-fe41fd4aec3a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:07.384579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836b160-9dbf-47d2-84b5-2a99024c23df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:07.385189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836b160-9dbf-47d2-84b5-2a99024c23df None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.385467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836b160-9dbf-47d2-84b5-2a99024c23df None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.385737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836b160-9dbf-47d2-84b5-2a99024c23df None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.386642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836b160-9dbf-47d2-84b5-2a99024c23df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:07.386949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836b160-9dbf-47d2-84b5-2a99024c23df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:07.388457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836b160-9dbf-47d2-84b5-2a99024c23df None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:07.407703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acacf3-1816-4732-83d3-0a4c0e5b9064 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:07.413295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 311/631] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 28 17:48:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:07.413295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7586e4-0da7-4228-aa0b-675af2c592d4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.413295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7586e4-0da7-4228-aa0b-675af2c592d4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.413295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7586e4-0da7-4228-aa0b-675af2c592d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.429695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-df7586e4-0da7-4228-aa0b-675af2c592d4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:07.431095 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-df7586e4-0da7-4228-aa0b-675af2c592d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:07.440953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:07.448629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6f8d6-b814-4df0-a271-038c3d6f5f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:07.449324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6f8d6-b814-4df0-a271-038c3d6f5f37 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.449607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6f8d6-b814-4df0-a271-038c3d6f5f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.463141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6f8d6-b814-4df0-a271-038c3d6f5f37 None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/38bd83f5a0bc4e7ea5cde1972c44503b/roles/467b18ae24a4482592d2b45bc717c5eb` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.465334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6f8d6-b814-4df0-a271-038c3d6f5f37 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=38bd83f5a0bc4e7ea5cde1972c44503b, role_id=467b18ae24a4482592d2b45bc717c5eb)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:07.466767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6f8d6-b814-4df0-a271-038c3d6f5f37 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:07.502475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 312/632] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:07.503321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7586e4-0da7-4228-aa0b-675af2c592d4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:07.554858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:07.567016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 321/633] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:07 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/38bd83f5a0bc4e7ea5cde1972c44503b/roles/467b18ae24a4482592d2b45bc717c5eb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:07.568056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6f8d6-b814-4df0-a271-038c3d6f5f37 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:07.608031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7586e4-0da7-4228-aa0b-675af2c592d4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:07.656533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa1e7-1a2a-481e-9ccf-207c88486f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:07.658192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa1e7-1a2a-481e-9ccf-207c88486f7f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.658699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa1e7-1a2a-481e-9ccf-207c88486f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.659170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa1e7-1a2a-481e-9ccf-207c88486f7f None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.660074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffa1e7-1a2a-481e-9ccf-207c88486f7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:07.661107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffa1e7-1a2a-481e-9ccf-207c88486f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:07.663191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffa1e7-1a2a-481e-9ccf-207c88486f7f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:07.677653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 313/634] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:07.677653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa1e7-1a2a-481e-9ccf-207c88486f7f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:07.692301 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6f8d6-b814-4df0-a271-038c3d6f5f37 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:07.734700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1b26a-7064-4020-95fe-47ec59efd934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:07.735644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1b26a-7064-4020-95fe-47ec59efd934 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.735917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1b26a-7064-4020-95fe-47ec59efd934 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.736216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1b26a-7064-4020-95fe-47ec59efd934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.787235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:07.795013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa1e7-1a2a-481e-9ccf-207c88486f7f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:07.808568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1b26a-7064-4020-95fe-47ec59efd934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:07.810235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:07.810651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1b26a-7064-4020-95fe-47ec59efd934 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:07.831187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a500c46-bcbb-4428-aafb-cc96b1cf511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:07.831842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a500c46-bcbb-4428-aafb-cc96b1cf511c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.832118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a500c46-bcbb-4428-aafb-cc96b1cf511c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.832845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a500c46-bcbb-4428-aafb-cc96b1cf511c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.845891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a500c46-bcbb-4428-aafb-cc96b1cf511c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8a500c46-bcbb-4428-aafb-cc96b1cf511c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:07.851322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:07.857557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 314/635] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:07.858398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f0766-6edd-49d4-a8fc-7c925c5987e2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.859206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f0766-6edd-49d4-a8fc-7c925c5987e2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.859206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f0766-6edd-49d4-a8fc-7c925c5987e2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.859206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 315/636] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:07.859206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f0766-6edd-49d4-a8fc-7c925c5987e2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:07.922769 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 322/637] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:07.925544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469559e4-798d-4c3f-a30b-ee9ddc3394ed None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:07.926042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469559e4-798d-4c3f-a30b-ee9ddc3394ed None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:07.926497 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469559e4-798d-4c3f-a30b-ee9ddc3394ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:07.946055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-469559e4-798d-4c3f-a30b-ee9ddc3394ed None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:07.947463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-469559e4-798d-4c3f-a30b-ee9ddc3394ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:07.980062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f0766-6edd-49d4-a8fc-7c925c5987e2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.016687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0239b9-7ae4-4bf3-9030-e5868a8bc97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.017458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0239b9-7ae4-4bf3-9030-e5868a8bc97d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.017748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0239b9-7ae4-4bf3-9030-e5868a8bc97d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.018031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0239b9-7ae4-4bf3-9030-e5868a8bc97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.029257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 323/638] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:08.029257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469559e4-798d-4c3f-a30b-ee9ddc3394ed None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.033355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0239b9-7ae4-4bf3-9030-e5868a8bc97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.034930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0239b9-7ae4-4bf3-9030-e5868a8bc97d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.041925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7d0239b9-7ae4-4bf3-9030-e5868a8bc97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:08.052845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:08.056602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:08.057736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:08.057736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:08.057736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:08.057736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:08.057736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 316/639] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:08.057736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0239b9-7ae4-4bf3-9030-e5868a8bc97d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.082782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:08.156474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0239b9-7ae4-4bf3-9030-e5868a8bc97d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.164070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469559e4-798d-4c3f-a30b-ee9ddc3394ed None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.193599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8281ae-9e3c-47b8-8c61-e8260a67584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.194460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8281ae-9e3c-47b8-8c61-e8260a67584e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.194896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8281ae-9e3c-47b8-8c61-e8260a67584e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.195229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8281ae-9e3c-47b8-8c61-e8260a67584e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.204867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef5d14-75af-4baa-8ab8-98d087cd9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.205391 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef5d14-75af-4baa-8ab8-98d087cd9961 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.205673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef5d14-75af-4baa-8ab8-98d087cd9961 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.206028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef5d14-75af-4baa-8ab8-98d087cd9961 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.206772 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef5d14-75af-4baa-8ab8-98d087cd9961 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:08.207011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8281ae-9e3c-47b8-8c61-e8260a67584e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.208460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8281ae-9e3c-47b8-8c61-e8260a67584e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.210420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef5d14-75af-4baa-8ab8-98d087cd9961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.212809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef5d14-75af-4baa-8ab8-98d087cd9961 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.225913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 324/640] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:08.225913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef5d14-75af-4baa-8ab8-98d087cd9961 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-6b8281ae-9e3c-47b8-8c61-e8260a67584e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:08.226168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:08.226964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:08.227847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:08.227847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:08.227847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:08.227847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:08.227847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 317/641] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:08.227847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8281ae-9e3c-47b8-8c61-e8260a67584e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.301675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:08.314763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:08.334020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef5d14-75af-4baa-8ab8-98d087cd9961 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.339084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8281ae-9e3c-47b8-8c61-e8260a67584e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.371635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36092d0-7ea1-4450-a93a-e26f4769d726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.372541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36092d0-7ea1-4450-a93a-e26f4769d726 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.372840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36092d0-7ea1-4450-a93a-e26f4769d726 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.373113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36092d0-7ea1-4450-a93a-e26f4769d726 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.374910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3731a8-9ad2-4c15-8dda-18af8c156147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.375639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3731a8-9ad2-4c15-8dda-18af8c156147 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.375921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3731a8-9ad2-4c15-8dda-18af8c156147 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.376287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3731a8-9ad2-4c15-8dda-18af8c156147 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.377137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3731a8-9ad2-4c15-8dda-18af8c156147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:08.377442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3731a8-9ad2-4c15-8dda-18af8c156147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.378930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3731a8-9ad2-4c15-8dda-18af8c156147 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.383210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36092d0-7ea1-4450-a93a-e26f4769d726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-f36092d0-7ea1-4450-a93a-e26f4769d726 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:08.388524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:08.389668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:08.390529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 325/642] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:08.391259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36092d0-7ea1-4450-a93a-e26f4769d726 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.395985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 318/643] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:08.397079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3731a8-9ad2-4c15-8dda-18af8c156147 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.502624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3731a8-9ad2-4c15-8dda-18af8c156147 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.502802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36092d0-7ea1-4450-a93a-e26f4769d726 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.534553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:08.540029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8951db2-42e8-480a-ade3-97261cad8417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.540163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb24b6-143e-4e7c-a778-1b7da8b6a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.540687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8951db2-42e8-480a-ade3-97261cad8417 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.540805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb24b6-143e-4e7c-a778-1b7da8b6a043 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.541043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8951db2-42e8-480a-ade3-97261cad8417 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.541155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb24b6-143e-4e7c-a778-1b7da8b6a043 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.541303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8951db2-42e8-480a-ade3-97261cad8417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.541394 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb24b6-143e-4e7c-a778-1b7da8b6a043 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.542029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb24b6-143e-4e7c-a778-1b7da8b6a043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:08.542299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb24b6-143e-4e7c-a778-1b7da8b6a043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.543655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb24b6-143e-4e7c-a778-1b7da8b6a043 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.544522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:08.553046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8951db2-42e8-480a-ade3-97261cad8417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.554573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8951db2-42e8-480a-ade3-97261cad8417 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.555381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 326/644] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:08.555986 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb24b6-143e-4e7c-a778-1b7da8b6a043 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d8951db2-42e8-480a-ade3-97261cad8417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:08.575014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:08.576134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:08.577242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:08.577242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:08.577242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:08.577242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:08.577242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 319/645] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:08.577242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8951db2-42e8-480a-ade3-97261cad8417 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.667728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb24b6-143e-4e7c-a778-1b7da8b6a043 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.684665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8951db2-42e8-480a-ade3-97261cad8417 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.705503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115246-fe2e-4baf-b65a-b58f6bdfc629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.706126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115246-fe2e-4baf-b65a-b58f6bdfc629 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.706407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115246-fe2e-4baf-b65a-b58f6bdfc629 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.706677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115246-fe2e-4baf-b65a-b58f6bdfc629 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.707408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03115246-fe2e-4baf-b65a-b58f6bdfc629 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:08.707711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03115246-fe2e-4baf-b65a-b58f6bdfc629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.709112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03115246-fe2e-4baf-b65a-b58f6bdfc629 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.717219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 327/646] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:08.720970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115246-fe2e-4baf-b65a-b58f6bdfc629 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.725841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e43ee-1a19-4856-b1c1-7988714c415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.726521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e43ee-1a19-4856-b1c1-7988714c415f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.726857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e43ee-1a19-4856-b1c1-7988714c415f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.727170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e43ee-1a19-4856-b1c1-7988714c415f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.736269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e43ee-1a19-4856-b1c1-7988714c415f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.737523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e43ee-1a19-4856-b1c1-7988714c415f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5f4e43ee-1a19-4856-b1c1-7988714c415f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:08.748824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:08.749758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 320/647] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:08.750695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e43ee-1a19-4856-b1c1-7988714c415f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.777966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:08.805091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:08.824843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115246-fe2e-4baf-b65a-b58f6bdfc629 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.858355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e43ee-1a19-4856-b1c1-7988714c415f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:08.859226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda472c-1708-481e-959a-b51e380edbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.859853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda472c-1708-481e-959a-b51e380edbdc None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.860127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda472c-1708-481e-959a-b51e380edbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.860453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda472c-1708-481e-959a-b51e380edbdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.867058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda472c-1708-481e-959a-b51e380edbdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.868521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda472c-1708-481e-959a-b51e380edbdc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-5dda472c-1708-481e-959a-b51e380edbdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:08.879678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:08.880564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 328/648] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:08.881774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda472c-1708-481e-959a-b51e380edbdc None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.900134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee6cc-c8b1-43e8-a53f-6c5663d1f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:08.901053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee6cc-c8b1-43e8-a53f-6c5663d1f656 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:08.901506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee6cc-c8b1-43e8-a53f-6c5663d1f656 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:08.901917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee6cc-c8b1-43e8-a53f-6c5663d1f656 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:08.902766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ee6cc-c8b1-43e8-a53f-6c5663d1f656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:08.903258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ee6cc-c8b1-43e8-a53f-6c5663d1f656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:08.904777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ee6cc-c8b1-43e8-a53f-6c5663d1f656 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:08.917053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 321/649] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:08.918015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee6cc-c8b1-43e8-a53f-6c5663d1f656 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:08.988820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda472c-1708-481e-959a-b51e380edbdc None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.002208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.024362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9c48-b321-46a5-bc5f-141c0b1857c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.025387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9c48-b321-46a5-bc5f-141c0b1857c7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.025768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9c48-b321-46a5-bc5f-141c0b1857c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.026047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d9c48-b321-46a5-bc5f-141c0b1857c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.029134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee6cc-c8b1-43e8-a53f-6c5663d1f656 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.037048 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d9c48-b321-46a5-bc5f-141c0b1857c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.038568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d9c48-b321-46a5-bc5f-141c0b1857c7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.040012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-1e2d9c48-b321-46a5-bc5f-141c0b1857c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:09.054214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:09.065730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:09.066836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:09.066836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:09.066836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:09.066836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:09.066836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 329/650] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:09.066836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9c48-b321-46a5-bc5f-141c0b1857c7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:09.075677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c8f0-5ef1-40ae-af91-9917ad0449a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.076577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c8f0-5ef1-40ae-af91-9917ad0449a5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.077050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c8f0-5ef1-40ae-af91-9917ad0449a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.077466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c8f0-5ef1-40ae-af91-9917ad0449a5 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.078424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c8f0-5ef1-40ae-af91-9917ad0449a5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:09.078889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c8f0-5ef1-40ae-af91-9917ad0449a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.081054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c8f0-5ef1-40ae-af91-9917ad0449a5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.104121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 322/651] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 28 17:48:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:09.104121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c8f0-5ef1-40ae-af91-9917ad0449a5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:09.168998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d9c48-b321-46a5-bc5f-141c0b1857c7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.204999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800813a-b01b-4955-9410-194dd2babe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.205616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800813a-b01b-4955-9410-194dd2babe53 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.205896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800813a-b01b-4955-9410-194dd2babe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.206170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800813a-b01b-4955-9410-194dd2babe53 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.206913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800813a-b01b-4955-9410-194dd2babe53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:09.207217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800813a-b01b-4955-9410-194dd2babe53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.208641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800813a-b01b-4955-9410-194dd2babe53 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.214130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c8f0-5ef1-40ae-af91-9917ad0449a5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.222408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 330/652] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:09.223058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800813a-b01b-4955-9410-194dd2babe53 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:09.249329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.255811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b25097-639f-4b10-8cf0-b1085f84c138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.259349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b25097-639f-4b10-8cf0-b1085f84c138 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.259349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b25097-639f-4b10-8cf0-b1085f84c138 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.259349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b25097-639f-4b10-8cf0-b1085f84c138 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.264675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b25097-639f-4b10-8cf0-b1085f84c138 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.266143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b25097-639f-4b10-8cf0-b1085f84c138 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b2b25097-639f-4b10-8cf0-b1085f84c138 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:09.278263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:09.279235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 323/653] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:09.280289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b25097-639f-4b10-8cf0-b1085f84c138 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:09.317096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.336765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800813a-b01b-4955-9410-194dd2babe53 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.371736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efcb29-3f89-4485-9ae9-22f0310b3f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.372479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efcb29-3f89-4485-9ae9-22f0310b3f31 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.372803 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efcb29-3f89-4485-9ae9-22f0310b3f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.373078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efcb29-3f89-4485-9ae9-22f0310b3f31 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.373763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efcb29-3f89-4485-9ae9-22f0310b3f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:09.374060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efcb29-3f89-4485-9ae9-22f0310b3f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.375411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efcb29-3f89-4485-9ae9-22f0310b3f31 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.391497 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 331/654] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:09.391497 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efcb29-3f89-4485-9ae9-22f0310b3f31 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:09.398998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b25097-639f-4b10-8cf0-b1085f84c138 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.445180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c46e83-5852-43ba-95ae-5612967e68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.446245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c46e83-5852-43ba-95ae-5612967e68b8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.446750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c46e83-5852-43ba-95ae-5612967e68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.447395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c46e83-5852-43ba-95ae-5612967e68b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.480565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.495791 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efcb29-3f89-4485-9ae9-22f0310b3f31 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.529398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c46e83-5852-43ba-95ae-5612967e68b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.530466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f69310-4c91-43cb-92c5-5342e1168049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.531080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f69310-4c91-43cb-92c5-5342e1168049 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.531354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f69310-4c91-43cb-92c5-5342e1168049 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.531621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f69310-4c91-43cb-92c5-5342e1168049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.532149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c46e83-5852-43ba-95ae-5612967e68b8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.532491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f69310-4c91-43cb-92c5-5342e1168049 None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=cb85b3e1dc464438ac007c1b09ea7fd3) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:09.532900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f69310-4c91-43cb-92c5-5342e1168049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.539719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f69310-4c91-43cb-92c5-5342e1168049 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.548881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 332/655] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:09 2022] GET /identity/v3/role_assignments?user.id=cb85b3e1dc464438ac007c1b09ea7fd3&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:09.548881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f69310-4c91-43cb-92c5-5342e1168049 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:09.570382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.657668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 324/656] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:09.658624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c46e83-5852-43ba-95ae-5612967e68b8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:09.689263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f69310-4c91-43cb-92c5-5342e1168049 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.727850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d631b2f-ac9a-47e4-9c4d-1c82cbf7d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.728472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d631b2f-ac9a-47e4-9c4d-1c82cbf7d030 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.728751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d631b2f-ac9a-47e4-9c4d-1c82cbf7d030 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.729091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d631b2f-ac9a-47e4-9c4d-1c82cbf7d030 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.729885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d631b2f-ac9a-47e4-9c4d-1c82cbf7d030 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:09.730446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d631b2f-ac9a-47e4-9c4d-1c82cbf7d030 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.731604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d631b2f-ac9a-47e4-9c4d-1c82cbf7d030 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.751941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 333/657] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 28 17:48:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:09.753278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ebce-320d-422f-ab13-936ffc1be518 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.753569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ebce-320d-422f-ab13-936ffc1be518 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.753843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338ebce-320d-422f-ab13-936ffc1be518 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.755057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 334/658] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:09.755739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ebce-320d-422f-ab13-936ffc1be518 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:09.766342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.789184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c46e83-5852-43ba-95ae-5612967e68b8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.818198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:09.826910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9ddfc-acbe-4524-85d7-79cf1a4f34a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.827549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9ddfc-acbe-4524-85d7-79cf1a4f34a8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.827828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9ddfc-acbe-4524-85d7-79cf1a4f34a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.832920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9ddfc-acbe-4524-85d7-79cf1a4f34a8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.835833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9ddfc-acbe-4524-85d7-79cf1a4f34a8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.837265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9ddfc-acbe-4524-85d7-79cf1a4f34a8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-41b9ddfc-acbe-4524-85d7-79cf1a4f34a8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:09.849091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:09.850234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 325/659] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:09.851178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9ddfc-acbe-4524-85d7-79cf1a4f34a8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:09.885862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338ebce-320d-422f-ab13-936ffc1be518 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.921653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67129cfd-e46b-4402-9e5e-d0be9f5e2e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:09.922420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67129cfd-e46b-4402-9e5e-d0be9f5e2e6e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.922602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67129cfd-e46b-4402-9e5e-d0be9f5e2e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.922825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67129cfd-e46b-4402-9e5e-d0be9f5e2e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.934265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67129cfd-e46b-4402-9e5e-d0be9f5e2e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:09.935755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67129cfd-e46b-4402-9e5e-d0be9f5e2e6e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-67129cfd-e46b-4402-9e5e-d0be9f5e2e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:09.951594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:09.952710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:09.958943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:09.958943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:09.958943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:09.958943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:09.958943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 335/660] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:09.958943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf119e-eeff-42fa-8006-77664ec21700 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:09.958943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf119e-eeff-42fa-8006-77664ec21700 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:09.958943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf119e-eeff-42fa-8006-77664ec21700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:09.967120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9ddfc-acbe-4524-85d7-79cf1a4f34a8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:09.974475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-1daf119e-eeff-42fa-8006-77664ec21700 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:09.975663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1daf119e-eeff-42fa-8006-77664ec21700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:10.000764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54d546-7373-4e83-8089-0d2f7a298280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:10.001460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d546-7373-4e83-8089-0d2f7a298280 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:10.001739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d546-7373-4e83-8089-0d2f7a298280 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:10.002017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d546-7373-4e83-8089-0d2f7a298280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:10.034662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:10.049867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 336/661] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:10.050237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf119e-eeff-42fa-8006-77664ec21700 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.066383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:10.080525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54d546-7373-4e83-8089-0d2f7a298280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:10.082341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54d546-7373-4e83-8089-0d2f7a298280 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:10.170813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf119e-eeff-42fa-8006-77664ec21700 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:10.190561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 326/662] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:10.191750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54d546-7373-4e83-8089-0d2f7a298280 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.213628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cdf0-670d-419c-bfaf-0fe9ffa9f653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:10.214251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cdf0-670d-419c-bfaf-0fe9ffa9f653 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:10.214527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cdf0-670d-419c-bfaf-0fe9ffa9f653 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:10.214792 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cdf0-670d-419c-bfaf-0fe9ffa9f653 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:10.216001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cdf0-670d-419c-bfaf-0fe9ffa9f653 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:10.216591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cdf0-670d-419c-bfaf-0fe9ffa9f653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:10.218590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cdf0-670d-419c-bfaf-0fe9ffa9f653 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:10.241971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 337/663] 10.222.0.67 () {56 vars in 1139 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:10.244135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cdf0-670d-419c-bfaf-0fe9ffa9f653 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.293400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:10.298750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:10.307463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54d546-7373-4e83-8089-0d2f7a298280 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:10.342278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df5b9e-49b3-4d7d-9a44-dad0090e6d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:10.343378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df5b9e-49b3-4d7d-9a44-dad0090e6d3f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:10.343939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df5b9e-49b3-4d7d-9a44-dad0090e6d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:10.344365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df5b9e-49b3-4d7d-9a44-dad0090e6d3f None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:10.345845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df5b9e-49b3-4d7d-9a44-dad0090e6d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:10.346303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df5b9e-49b3-4d7d-9a44-dad0090e6d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:10.353121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df5b9e-49b3-4d7d-9a44-dad0090e6d3f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:10.353285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cdf0-670d-419c-bfaf-0fe9ffa9f653 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:10.362867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 327/664] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:10.364284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df5b9e-49b3-4d7d-9a44-dad0090e6d3f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.393948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208a8d-a443-42c8-b03d-8d5f004d9727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:10.394679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208a8d-a443-42c8-b03d-8d5f004d9727 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:10.394966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208a8d-a443-42c8-b03d-8d5f004d9727 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:10.395246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208a8d-a443-42c8-b03d-8d5f004d9727 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:10.405894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78208a8d-a443-42c8-b03d-8d5f004d9727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-78208a8d-a443-42c8-b03d-8d5f004d9727 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:10.410800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:10.411725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:10.412577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 338/665] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:10.413753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208a8d-a443-42c8-b03d-8d5f004d9727 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.473813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df5b9e-49b3-4d7d-9a44-dad0090e6d3f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:10.508370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a454f9-f8a5-493c-9c7f-eaca70f23456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:10.509285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a454f9-f8a5-493c-9c7f-eaca70f23456 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:10.509762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a454f9-f8a5-493c-9c7f-eaca70f23456 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:10.510105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a454f9-f8a5-493c-9c7f-eaca70f23456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:10.518797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208a8d-a443-42c8-b03d-8d5f004d9727 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:10.526542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:10.526793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a454f9-f8a5-493c-9c7f-eaca70f23456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:10.528504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a454f9-f8a5-493c-9c7f-eaca70f23456 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:10.535047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-47a454f9-f8a5-493c-9c7f-eaca70f23456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:10.543412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:10.544397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:10.545385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:10.545385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:10.545385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:10.545385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:10.546025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 328/666] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:10.546805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a454f9-f8a5-493c-9c7f-eaca70f23456 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.557624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efc0c7-19da-4a7a-82c6-91c2fabf7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:10.558181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efc0c7-19da-4a7a-82c6-91c2fabf7554 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:10.558463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efc0c7-19da-4a7a-82c6-91c2fabf7554 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:10.558739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efc0c7-19da-4a7a-82c6-91c2fabf7554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:10.630328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efc0c7-19da-4a7a-82c6-91c2fabf7554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:10.631779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efc0c7-19da-4a7a-82c6-91c2fabf7554 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:10.656736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a454f9-f8a5-493c-9c7f-eaca70f23456 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:10.697701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f493ae-1ab7-465e-a400-f3361d23e31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:10.698833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f493ae-1ab7-465e-a400-f3361d23e31d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:10.699114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f493ae-1ab7-465e-a400-f3361d23e31d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:10.699531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f493ae-1ab7-465e-a400-f3361d23e31d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:10.707048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f493ae-1ab7-465e-a400-f3361d23e31d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:10.708478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f493ae-1ab7-465e-a400-f3361d23e31d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-42f493ae-1ab7-465e-a400-f3361d23e31d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:10.720555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:10.721716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:10.722616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:10.722616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:10.722616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:10.722616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:10.722616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:10.722616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:10.722616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:10.722616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:10.726475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 329/667] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:10.726475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f493ae-1ab7-465e-a400-f3361d23e31d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.746218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 339/668] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:10.746218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efc0c7-19da-4a7a-82c6-91c2fabf7554 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.750889 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:10.795409 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:10.841881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f493ae-1ab7-465e-a400-f3361d23e31d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:10.845777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efc0c7-19da-4a7a-82c6-91c2fabf7554 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:10.878753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a356a1-024d-4fe3-83fe-2c4d4e66818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:10.879363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a356a1-024d-4fe3-83fe-2c4d4e66818e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:10.879636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a356a1-024d-4fe3-83fe-2c4d4e66818e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:10.879906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a356a1-024d-4fe3-83fe-2c4d4e66818e None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:10.880611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a356a1-024d-4fe3-83fe-2c4d4e66818e None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:10.880980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a356a1-024d-4fe3-83fe-2c4d4e66818e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:10.881570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a45a5-827b-489d-aae1-c7fc559b957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:10.882182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a45a5-827b-489d-aae1-c7fc559b957b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:10.882287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a356a1-024d-4fe3-83fe-2c4d4e66818e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:10.882463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a45a5-827b-489d-aae1-c7fc559b957b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:10.882790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a45a5-827b-489d-aae1-c7fc559b957b None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:10.883674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a45a5-827b-489d-aae1-c7fc559b957b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:10.883987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a45a5-827b-489d-aae1-c7fc559b957b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:10.885721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a45a5-827b-489d-aae1-c7fc559b957b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:10.895112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 330/669] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:10.895949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a356a1-024d-4fe3-83fe-2c4d4e66818e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.902029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 340/670] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:10.902029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a45a5-827b-489d-aae1-c7fc559b957b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:10.972006 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:10.999486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a356a1-024d-4fe3-83fe-2c4d4e66818e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.008326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a45a5-827b-489d-aae1-c7fc559b957b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.021103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:11.035294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe020c-6e1f-41ff-88ec-a767a0eb6206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.035914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe020c-6e1f-41ff-88ec-a767a0eb6206 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.036324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe020c-6e1f-41ff-88ec-a767a0eb6206 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.036433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe020c-6e1f-41ff-88ec-a767a0eb6206 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.037280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe020c-6e1f-41ff-88ec-a767a0eb6206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:11.044979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe020c-6e1f-41ff-88ec-a767a0eb6206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.044979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe020c-6e1f-41ff-88ec-a767a0eb6206 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.045171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f33264-34c6-4e8c-960b-5a1d92c60b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.045171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33264-34c6-4e8c-960b-5a1d92c60b24 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.045422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33264-34c6-4e8c-960b-5a1d92c60b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.045755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33264-34c6-4e8c-960b-5a1d92c60b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.055776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 331/671] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:11.055776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe020c-6e1f-41ff-88ec-a767a0eb6206 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.058367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f33264-34c6-4e8c-960b-5a1d92c60b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.059855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f33264-34c6-4e8c-960b-5a1d92c60b24 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-24f33264-34c6-4e8c-960b-5a1d92c60b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:11.077836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:11.078768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:11.079736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:11.079736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:11.079736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:11.079736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:11.079736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 341/672] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:11.084135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f33264-34c6-4e8c-960b-5a1d92c60b24 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.164158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe020c-6e1f-41ff-88ec-a767a0eb6206 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.198147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f33264-34c6-4e8c-960b-5a1d92c60b24 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.201562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290ef71-c219-424f-881c-3519f3d9eb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.202277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290ef71-c219-424f-881c-3519f3d9eb7b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.202629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290ef71-c219-424f-881c-3519f3d9eb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.202958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290ef71-c219-424f-881c-3519f3d9eb7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.214771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290ef71-c219-424f-881c-3519f3d9eb7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.216334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290ef71-c219-424f-881c-3519f3d9eb7b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.216472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8290ef71-c219-424f-881c-3519f3d9eb7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:11.232246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:11.233898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:11.234842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:11.234842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:11.234842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:11.234842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:11.235167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ef8c-53a7-40d3-9937-6342123804e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.235167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ef8c-53a7-40d3-9937-6342123804e7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.235827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 332/673] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:11.235827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290ef71-c219-424f-881c-3519f3d9eb7b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.238577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ef8c-53a7-40d3-9937-6342123804e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.238878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4ef8c-53a7-40d3-9937-6342123804e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.246321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ef8c-53a7-40d3-9937-6342123804e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.247768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4ef8c-53a7-40d3-9937-6342123804e7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-9dd4ef8c-53a7-40d3-9937-6342123804e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:11.260084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:11.261161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:11.262058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:11.262058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:11.262058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:11.262058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:11.262058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:11.262058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:11.262058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:11.262058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:11.262058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 342/674] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:11.262541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ef8c-53a7-40d3-9937-6342123804e7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.274765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:11.348910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290ef71-c219-424f-881c-3519f3d9eb7b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.368629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4ef8c-53a7-40d3-9937-6342123804e7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.386653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a6ca4-e7e0-4aac-8fa9-ad3d2e4d7af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.387428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a6ca4-e7e0-4aac-8fa9-ad3d2e4d7af1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.387805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a6ca4-e7e0-4aac-8fa9-ad3d2e4d7af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.388180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a6ca4-e7e0-4aac-8fa9-ad3d2e4d7af1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.389171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a6ca4-e7e0-4aac-8fa9-ad3d2e4d7af1 None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=3a4c879f65c24edea2404cb74ac37025) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:11.389584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a6ca4-e7e0-4aac-8fa9-ad3d2e4d7af1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.391137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a6ca4-e7e0-4aac-8fa9-ad3d2e4d7af1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.398005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 333/675] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/role_assignments?user.id=3a4c879f65c24edea2404cb74ac37025&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:11.398005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a6ca4-e7e0-4aac-8fa9-ad3d2e4d7af1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.418825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a518d2-bb7d-4451-a19c-cd9f79e4f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.419554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a518d2-bb7d-4451-a19c-cd9f79e4f5ae None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.419992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a518d2-bb7d-4451-a19c-cd9f79e4f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.420370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a518d2-bb7d-4451-a19c-cd9f79e4f5ae None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.421232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a518d2-bb7d-4451-a19c-cd9f79e4f5ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:11.421748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a518d2-bb7d-4451-a19c-cd9f79e4f5ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.423938 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a518d2-bb7d-4451-a19c-cd9f79e4f5ae None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.444820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 343/676] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:11.444820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a518d2-bb7d-4451-a19c-cd9f79e4f5ae None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.496474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:11.536274 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:11.544838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a6ca4-e7e0-4aac-8fa9-ad3d2e4d7af1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.562866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a518d2-bb7d-4451-a19c-cd9f79e4f5ae None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.599606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c9c4-9a99-4954-b573-51c45e0523f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.600348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c9c4-9a99-4954-b573-51c45e0523f6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.600717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c9c4-9a99-4954-b573-51c45e0523f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.601276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c9c4-9a99-4954-b573-51c45e0523f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.601994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644c9c4-9a99-4954-b573-51c45e0523f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:11.602300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644c9c4-9a99-4954-b573-51c45e0523f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.603659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644c9c4-9a99-4954-b573-51c45e0523f6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.611425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bab490-3083-40cf-95ed-65109ec4b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.612055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bab490-3083-40cf-95ed-65109ec4b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.612494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bab490-3083-40cf-95ed-65109ec4b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.612773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bab490-3083-40cf-95ed-65109ec4b6d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.613560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bab490-3083-40cf-95ed-65109ec4b6d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:11.613869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bab490-3083-40cf-95ed-65109ec4b6d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.615327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bab490-3083-40cf-95ed-65109ec4b6d1 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.620032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 334/677] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:11.621076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c9c4-9a99-4954-b573-51c45e0523f6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.633937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 344/678] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:11.635467 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f2785-6fd2-487e-bdad-a1fba4651b52 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.635865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f2785-6fd2-487e-bdad-a1fba4651b52 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.636244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f2785-6fd2-487e-bdad-a1fba4651b52 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.637623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 345/679] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:11.638400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f2785-6fd2-487e-bdad-a1fba4651b52 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.744815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c9c4-9a99-4954-b573-51c45e0523f6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.745711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:11.750518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f2785-6fd2-487e-bdad-a1fba4651b52 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.779973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d886af2-a79e-474d-96dc-91b751f430d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.780609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d886af2-a79e-474d-96dc-91b751f430d6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.780922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d886af2-a79e-474d-96dc-91b751f430d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.781195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d886af2-a79e-474d-96dc-91b751f430d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.787062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65c945-0ed7-48eb-952b-5fe408fb2a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.787700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c945-0ed7-48eb-952b-5fe408fb2a6f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.787977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c945-0ed7-48eb-952b-5fe408fb2a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.788245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65c945-0ed7-48eb-952b-5fe408fb2a6f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.788682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d886af2-a79e-474d-96dc-91b751f430d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.790146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d886af2-a79e-474d-96dc-91b751f430d6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.795923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65c945-0ed7-48eb-952b-5fe408fb2a6f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.797402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65c945-0ed7-48eb-952b-5fe408fb2a6f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4d886af2-a79e-474d-96dc-91b751f430d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:11.802358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:11.803463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:11.804586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:11.804586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:11.804586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:11.804586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:11.804586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:11.804586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:11.804586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:11.804586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:11.809212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 335/680] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:11.809800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d886af2-a79e-474d-96dc-91b751f430d6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-0a65c945-0ed7-48eb-952b-5fe408fb2a6f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:11.811150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:11.812242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:11.813653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:11.814639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 346/681] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:11.814965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9079ef-5658-4377-807b-1a6efca86311 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.815242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9079ef-5658-4377-807b-1a6efca86311 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.815515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9079ef-5658-4377-807b-1a6efca86311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.838828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:11.841974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9e9079ef-5658-4377-807b-1a6efca86311 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:11.843350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9e9079ef-5658-4377-807b-1a6efca86311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:11.921102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 347/682] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:11.922245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9079ef-5658-4377-807b-1a6efca86311 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:11.940939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d886af2-a79e-474d-96dc-91b751f430d6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:11.980005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34f8ec-6d28-4d79-bbed-fc990c39f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:11.980625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34f8ec-6d28-4d79-bbed-fc990c39f48f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:11.981002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34f8ec-6d28-4d79-bbed-fc990c39f48f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:11.981281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34f8ec-6d28-4d79-bbed-fc990c39f48f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:11.982506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34f8ec-6d28-4d79-bbed-fc990c39f48f None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=18138af1ea504faca84b0cc2034ddd36) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:11.982822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34f8ec-6d28-4d79-bbed-fc990c39f48f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:11.984251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34f8ec-6d28-4d79-bbed-fc990c39f48f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:12.000903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 336/683] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/role_assignments?user.id=18138af1ea504faca84b0cc2034ddd36&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:12.000903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34f8ec-6d28-4d79-bbed-fc990c39f48f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:12.046350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:12.065817 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9079ef-5658-4377-807b-1a6efca86311 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:12.091628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:12.113127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf713c91-8816-489a-ab97-69c34f0cbb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:12.114185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf713c91-8816-489a-ab97-69c34f0cbb60 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.114713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf713c91-8816-489a-ab97-69c34f0cbb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.115323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf713c91-8816-489a-ab97-69c34f0cbb60 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.116345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf713c91-8816-489a-ab97-69c34f0cbb60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:12.116896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf713c91-8816-489a-ab97-69c34f0cbb60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:12.117108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34f8ec-6d28-4d79-bbed-fc990c39f48f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:12.118887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf713c91-8816-489a-ab97-69c34f0cbb60 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:12.136925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 348/684] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:12.138254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf713c91-8816-489a-ab97-69c34f0cbb60 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:12.174852 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e34160-bebe-48ea-a8ab-c3eebd73b374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:12.175468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e34160-bebe-48ea-a8ab-c3eebd73b374 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.175747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e34160-bebe-48ea-a8ab-c3eebd73b374 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.176019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e34160-bebe-48ea-a8ab-c3eebd73b374 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.177811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e34160-bebe-48ea-a8ab-c3eebd73b374 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:12.177811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e34160-bebe-48ea-a8ab-c3eebd73b374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:12.178581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e34160-bebe-48ea-a8ab-c3eebd73b374 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:12.203381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 337/685] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 28 17:48:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:12.205481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e34160-bebe-48ea-a8ab-c3eebd73b374 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:12.289658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf713c91-8816-489a-ab97-69c34f0cbb60 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:12.325774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e34160-bebe-48ea-a8ab-c3eebd73b374 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:12.328238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a11b7-5aad-4c06-957d-db0b41d95ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:12.330244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a11b7-5aad-4c06-957d-db0b41d95ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.330540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a11b7-5aad-4c06-957d-db0b41d95ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.330815 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a11b7-5aad-4c06-957d-db0b41d95ad1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.342853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a11b7-5aad-4c06-957d-db0b41d95ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-b78a11b7-5aad-4c06-957d-db0b41d95ad1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:12.350013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:12.350965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 349/686] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:12.352236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a11b7-5aad-4c06-957d-db0b41d95ad1 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:12.369119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:12.377281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a43d4-761b-4b65-8148-05db123af792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:12.377898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a43d4-761b-4b65-8148-05db123af792 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.381394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a43d4-761b-4b65-8148-05db123af792 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.381394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a43d4-761b-4b65-8148-05db123af792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.381394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a43d4-761b-4b65-8148-05db123af792 None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=0116171a83f5444d91ce0ea2439a9bd2) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:12.381394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a43d4-761b-4b65-8148-05db123af792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:12.381394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a43d4-761b-4b65-8148-05db123af792 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:12.387387 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 338/687] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:12 2022] GET /identity/v3/role_assignments?user.id=0116171a83f5444d91ce0ea2439a9bd2&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:12.388351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a43d4-761b-4b65-8148-05db123af792 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:12.390973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:12.566764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a11b7-5aad-4c06-957d-db0b41d95ad1 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:12.607315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d339-2d61-4a57-b96c-225687bca4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:12.608084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d339-2d61-4a57-b96c-225687bca4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.608366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d339-2d61-4a57-b96c-225687bca4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.608648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d339-2d61-4a57-b96c-225687bca4f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.610507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a43d4-761b-4b65-8148-05db123af792 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:12.669210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a5977-9edf-478d-9042-4bc5333eedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:12.669900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a5977-9edf-478d-9042-4bc5333eedd1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.670185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a5977-9edf-478d-9042-4bc5333eedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.670456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a5977-9edf-478d-9042-4bc5333eedd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.671588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a5977-9edf-478d-9042-4bc5333eedd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:12.671893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a5977-9edf-478d-9042-4bc5333eedd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:12.673830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a5977-9edf-478d-9042-4bc5333eedd1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:12.686646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 339/688] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:12.692375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a5977-9edf-478d-9042-4bc5333eedd1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:12.695302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0d339-2d61-4a57-b96c-225687bca4f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:12.697195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0d339-2d61-4a57-b96c-225687bca4f7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:12.708863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:12.761398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:12.802180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a5977-9edf-478d-9042-4bc5333eedd1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:12.804020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 350/689] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:12.809428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d339-2d61-4a57-b96c-225687bca4f7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:12.839432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7e639-9778-4fd2-a323-44afb991432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:12.840320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7e639-9778-4fd2-a323-44afb991432b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.840744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7e639-9778-4fd2-a323-44afb991432b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.841194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7e639-9778-4fd2-a323-44afb991432b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.852973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7e639-9778-4fd2-a323-44afb991432b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:12.854638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7e639-9778-4fd2-a323-44afb991432b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b2c7e639-9778-4fd2-a323-44afb991432b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:12.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:12.870694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:12.871781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:12.871781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:12.871781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:12.871781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:12.873624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 340/690] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:12.879201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7e639-9778-4fd2-a323-44afb991432b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:12.920832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d339-2d61-4a57-b96c-225687bca4f7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:12.927331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:12.951800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c045c-5db5-433c-a8ad-3d43fc76e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:12.952593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c045c-5db5-433c-a8ad-3d43fc76e073 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:12.953040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c045c-5db5-433c-a8ad-3d43fc76e073 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:12.953415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c045c-5db5-433c-a8ad-3d43fc76e073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:12.975579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c045c-5db5-433c-a8ad-3d43fc76e073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:12.977102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c045c-5db5-433c-a8ad-3d43fc76e073 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-e79c045c-5db5-433c-a8ad-3d43fc76e073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:13.009253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:13.010234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:13.011770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:13.011770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:13.011770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:13.011770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:13.011770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 351/691] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:13.015848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c045c-5db5-433c-a8ad-3d43fc76e073 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:13.040838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7e639-9778-4fd2-a323-44afb991432b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:13.054093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:13.082498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd3a0d-2d6f-4a65-b413-21f2d9d01d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:13.083125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd3a0d-2d6f-4a65-b413-21f2d9d01d30 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.083499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd3a0d-2d6f-4a65-b413-21f2d9d01d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.083772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd3a0d-2d6f-4a65-b413-21f2d9d01d30 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.084466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd3a0d-2d6f-4a65-b413-21f2d9d01d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:13.084767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd3a0d-2d6f-4a65-b413-21f2d9d01d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:13.090294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd3a0d-2d6f-4a65-b413-21f2d9d01d30 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.110766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 341/692] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:13.116268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd3a0d-2d6f-4a65-b413-21f2d9d01d30 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:13.190433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c045c-5db5-433c-a8ad-3d43fc76e073 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:13.225955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f70e33-28c8-4879-839c-711ee1014d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:13.226570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f70e33-28c8-4879-839c-711ee1014d92 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.226848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f70e33-28c8-4879-839c-711ee1014d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.227122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f70e33-28c8-4879-839c-711ee1014d92 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.227809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f70e33-28c8-4879-839c-711ee1014d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:13.228110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f70e33-28c8-4879-839c-711ee1014d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:13.229500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f70e33-28c8-4879-839c-711ee1014d92 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.241868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 352/693] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:13.249793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f70e33-28c8-4879-839c-711ee1014d92 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:13.290683 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:13.298705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd3a0d-2d6f-4a65-b413-21f2d9d01d30 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:13.362518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d76da8-fe4d-49b2-9f4f-52065eded8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:13.363078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d76da8-fe4d-49b2-9f4f-52065eded8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.363358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d76da8-fe4d-49b2-9f4f-52065eded8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.363633 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d76da8-fe4d-49b2-9f4f-52065eded8b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.371073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d76da8-fe4d-49b2-9f4f-52065eded8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:13.372492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d76da8-fe4d-49b2-9f4f-52065eded8b6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.381538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f70e33-28c8-4879-839c-711ee1014d92 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-88d76da8-fe4d-49b2-9f4f-52065eded8b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:13.384938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:13.386187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:13.387368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 342/694] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 28 17:48:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:13.391173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d76da8-fe4d-49b2-9f4f-52065eded8b6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:13.431572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:13.452364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8698f6e-058c-4848-981f-0dad525acc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:13.453035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8698f6e-058c-4848-981f-0dad525acc67 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.453328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8698f6e-058c-4848-981f-0dad525acc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.453587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8698f6e-058c-4848-981f-0dad525acc67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.468973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8698f6e-058c-4848-981f-0dad525acc67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:13.472369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8698f6e-058c-4848-981f-0dad525acc67 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d8698f6e-058c-4848-981f-0dad525acc67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:13.494808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:13.495782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:13.497362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:13.497362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:13.497362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:13.497362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:13.497362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:13.497362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:13.497362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:13.497362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:13.497362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 353/695] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:13.505817 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8698f6e-058c-4848-981f-0dad525acc67 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:13.530311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d76da8-fe4d-49b2-9f4f-52065eded8b6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:13.568114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745cc64-178c-46d3-9f32-a7c6f06639ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:13.568740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745cc64-178c-46d3-9f32-a7c6f06639ba None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.569047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745cc64-178c-46d3-9f32-a7c6f06639ba None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.569321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745cc64-178c-46d3-9f32-a7c6f06639ba None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.570259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745cc64-178c-46d3-9f32-a7c6f06639ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:13.570570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745cc64-178c-46d3-9f32-a7c6f06639ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:13.572001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745cc64-178c-46d3-9f32-a7c6f06639ba None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.591424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 343/696] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 28 17:48:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:13.597054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745cc64-178c-46d3-9f32-a7c6f06639ba None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:13.684333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:13.704940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8698f6e-058c-4848-981f-0dad525acc67 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:13.714006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:13.723197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745cc64-178c-46d3-9f32-a7c6f06639ba None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:13.744426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9afee-95c5-4ac2-8652-fef257695b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:13.745050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9afee-95c5-4ac2-8652-fef257695b95 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.745335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9afee-95c5-4ac2-8652-fef257695b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.745611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9afee-95c5-4ac2-8652-fef257695b95 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.746360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9afee-95c5-4ac2-8652-fef257695b95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:13.746668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9afee-95c5-4ac2-8652-fef257695b95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:13.748102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9afee-95c5-4ac2-8652-fef257695b95 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.760353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 354/697] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:13.761686 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec1682-1d7f-4dc2-9845-e3a011886829 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.761972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec1682-1d7f-4dc2-9845-e3a011886829 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.762308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec1682-1d7f-4dc2-9845-e3a011886829 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.764445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 355/698] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:13.768610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec1682-1d7f-4dc2-9845-e3a011886829 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:13.771559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71694600-d868-4ab3-be08-e33bbc4e12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:13.772451 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71694600-d868-4ab3-be08-e33bbc4e12e0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.772959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71694600-d868-4ab3-be08-e33bbc4e12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.773417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71694600-d868-4ab3-be08-e33bbc4e12e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.862809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71694600-d868-4ab3-be08-e33bbc4e12e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:13.864100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71694600-d868-4ab3-be08-e33bbc4e12e0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.888681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec1682-1d7f-4dc2-9845-e3a011886829 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:13.926483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bdb52-1b35-4c5b-833f-df83ac7f6a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:13.927887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bdb52-1b35-4c5b-833f-df83ac7f6a4e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.928574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bdb52-1b35-4c5b-833f-df83ac7f6a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.929261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bdb52-1b35-4c5b-833f-df83ac7f6a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.930954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bdb52-1b35-4c5b-833f-df83ac7f6a4e None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=38bd83f5a0bc4e7ea5cde1972c44503b) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:13.931715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bdb52-1b35-4c5b-833f-df83ac7f6a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:13.933696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bdb52-1b35-4c5b-833f-df83ac7f6a4e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:13.941425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 356/699] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:13 2022] GET /identity/v3/role_assignments?user.id=38bd83f5a0bc4e7ea5cde1972c44503b&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:13.942845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63e74-d949-4ca1-b6e1-96a1aa6992ad None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:13.943314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63e74-d949-4ca1-b6e1-96a1aa6992ad None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:13.943771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63e74-d949-4ca1-b6e1-96a1aa6992ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:13.953709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:13.977306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-dea63e74-d949-4ca1-b6e1-96a1aa6992ad None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:13.980285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-dea63e74-d949-4ca1-b6e1-96a1aa6992ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:13.997188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.015998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 344/700] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 17:48:14.021956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71694600-d868-4ab3-be08-e33bbc4e12e0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:14.080988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 357/701] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:14.097373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea63e74-d949-4ca1-b6e1-96a1aa6992ad None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:14.213156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71694600-d868-4ab3-be08-e33bbc4e12e0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:14.229095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea63e74-d949-4ca1-b6e1-96a1aa6992ad None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:14.254865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a82eb2-f18b-466f-96ad-1ca156f5b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:14.255881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a82eb2-f18b-466f-96ad-1ca156f5b203 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.256354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a82eb2-f18b-466f-96ad-1ca156f5b203 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.256925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a82eb2-f18b-466f-96ad-1ca156f5b203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.268740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a82eb2-f18b-466f-96ad-1ca156f5b203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:14.270207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a82eb2-f18b-466f-96ad-1ca156f5b203 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:14.276282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21b62e-fb94-4f89-bba8-325ecf44bb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:14.277089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b62e-fb94-4f89-bba8-325ecf44bb86 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.277266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b62e-fb94-4f89-bba8-325ecf44bb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.277597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b62e-fb94-4f89-bba8-325ecf44bb86 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.278151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21b62e-fb94-4f89-bba8-325ecf44bb86 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:14.279521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21b62e-fb94-4f89-bba8-325ecf44bb86 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:14.281677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-77a82eb2-f18b-466f-96ad-1ca156f5b203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:14.287484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:14.288399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:14.289390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:14.289390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:14.289390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:14.289390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:14.289390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 345/702] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-9c21b62e-fb94-4f89-bba8-325ecf44bb86 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:14.294758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:14.306539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:14.307380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 358/703] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:14.308231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a82eb2-f18b-466f-96ad-1ca156f5b203 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:14.308621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21b62e-fb94-4f89-bba8-325ecf44bb86 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:14.367216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.452647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a82eb2-f18b-466f-96ad-1ca156f5b203 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:14.461512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21b62e-fb94-4f89-bba8-325ecf44bb86 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:14.522277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e28377-647a-460c-a0c0-386b4a3bd682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:14.524422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e28377-647a-460c-a0c0-386b4a3bd682 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.525661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e28377-647a-460c-a0c0-386b4a3bd682 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.526501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e28377-647a-460c-a0c0-386b4a3bd682 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.527922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e28377-647a-460c-a0c0-386b4a3bd682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:14.534148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e28377-647a-460c-a0c0-386b4a3bd682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:14.534148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e28377-647a-460c-a0c0-386b4a3bd682 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:14.534866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8f438-f502-4566-b214-d62bb5ea6fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:14.535712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f438-f502-4566-b214-d62bb5ea6fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.536206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f438-f502-4566-b214-d62bb5ea6fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.536671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f438-f502-4566-b214-d62bb5ea6fe1 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.537594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8f438-f502-4566-b214-d62bb5ea6fe1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:14.538117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8f438-f502-4566-b214-d62bb5ea6fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:14.539843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8f438-f502-4566-b214-d62bb5ea6fe1 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:14.545596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 359/705] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:14.550391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 346/705] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:14.551623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8f438-f502-4566-b214-d62bb5ea6fe1 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:14.553722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e28377-647a-460c-a0c0-386b4a3bd682 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:14.639726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.677771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e28377-647a-460c-a0c0-386b4a3bd682 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:14.686353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.689714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8f438-f502-4566-b214-d62bb5ea6fe1 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:14.714087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4000a-f0e5-4af8-b058-b7e1dcef2617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:14.715327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4000a-f0e5-4af8-b058-b7e1dcef2617 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.715766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4000a-f0e5-4af8-b058-b7e1dcef2617 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.716341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4000a-f0e5-4af8-b058-b7e1dcef2617 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.717116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4000a-f0e5-4af8-b058-b7e1dcef2617 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:14.717481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4000a-f0e5-4af8-b058-b7e1dcef2617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:14.719422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4000a-f0e5-4af8-b058-b7e1dcef2617 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:14.732820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 347/706] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:14.732820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d719-e973-4f76-9ba0-365baf255dfa None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.732820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d719-e973-4f76-9ba0-365baf255dfa None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.732820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d719-e973-4f76-9ba0-365baf255dfa None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.732820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 348/707] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:14.735056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c432f6c-d91e-473d-a6b3-3a0c464e40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:14.736308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c432f6c-d91e-473d-a6b3-3a0c464e40e6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.736583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c432f6c-d91e-473d-a6b3-3a0c464e40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.736896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c432f6c-d91e-473d-a6b3-3a0c464e40e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.747157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c432f6c-d91e-473d-a6b3-3a0c464e40e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:14.747157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c432f6c-d91e-473d-a6b3-3a0c464e40e6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:14.749898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83bc5-a882-438c-b6ff-5eebc27ec0b9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.750180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83bc5-a882-438c-b6ff-5eebc27ec0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.750447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83bc5-a882-438c-b6ff-5eebc27ec0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-6c432f6c-d91e-473d-a6b3-3a0c464e40e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:14.780919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:14.781904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:14.783347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:14.783347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:14.783347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:14.783347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:14.783347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:14.783347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:14.783347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:14.783347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:14.784384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-81f83bc5-a882-438c-b6ff-5eebc27ec0b9 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:14.790138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-81f83bc5-a882-438c-b6ff-5eebc27ec0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:14.792777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 360/708] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:14.794814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c432f6c-d91e-473d-a6b3-3a0c464e40e6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:14.913347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c432f6c-d91e-473d-a6b3-3a0c464e40e6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:14.943127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:14.957923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef4e81-4b13-4344-8d52-bdd8b3d714ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:14.960816 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 349/709] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:48:14.960937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4e81-4b13-4344-8d52-bdd8b3d714ad None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.960937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4e81-4b13-4344-8d52-bdd8b3d714ad None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.960937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4e81-4b13-4344-8d52-bdd8b3d714ad None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.960937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef4e81-4b13-4344-8d52-bdd8b3d714ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:14.963343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d47b-eebb-4543-912d-0661fd184b80 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.963438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef4e81-4b13-4344-8d52-bdd8b3d714ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:14.963517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d47b-eebb-4543-912d-0661fd184b80 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.963517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d47b-eebb-4543-912d-0661fd184b80 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.964954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef4e81-4b13-4344-8d52-bdd8b3d714ad None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:14.965053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 350/710] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:14.982323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4aed8-1eb5-46be-885c-ca33509622e9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:14.982602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4aed8-1eb5-46be-885c-ca33509622e9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:14.982876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4aed8-1eb5-46be-885c-ca33509622e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:14.986093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 361/711] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:14.991348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef4e81-4b13-4344-8d52-bdd8b3d714ad None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:15.005779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-55d4aed8-1eb5-46be-885c-ca33509622e9 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:15.007034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-55d4aed8-1eb5-46be-885c-ca33509622e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:15.080188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 351/712] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:15.081140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4aed8-1eb5-46be-885c-ca33509622e9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:15.129935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef4e81-4b13-4344-8d52-bdd8b3d714ad None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:15.139405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:15.167069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1a30e-c4f9-4d74-b362-2882c76ef7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:15.167832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1a30e-c4f9-4d74-b362-2882c76ef7eb None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:15.168217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1a30e-c4f9-4d74-b362-2882c76ef7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:15.168596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1a30e-c4f9-4d74-b362-2882c76ef7eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:15.169531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1a30e-c4f9-4d74-b362-2882c76ef7eb None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=cb85b3e1dc464438ac007c1b09ea7fd3) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:15.169993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1a30e-c4f9-4d74-b362-2882c76ef7eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:15.171511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1a30e-c4f9-4d74-b362-2882c76ef7eb None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:15.184942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 362/713] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:14 2022] GET /identity/v3/role_assignments?user.id=cb85b3e1dc464438ac007c1b09ea7fd3&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:15.186269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1a30e-c4f9-4d74-b362-2882c76ef7eb None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:15.233071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4aed8-1eb5-46be-885c-ca33509622e9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:15.284032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48120d72-7830-4822-8107-624a9e218875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:15.285413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48120d72-7830-4822-8107-624a9e218875 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:15.287175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48120d72-7830-4822-8107-624a9e218875 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:15.287675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48120d72-7830-4822-8107-624a9e218875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:15.311828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48120d72-7830-4822-8107-624a9e218875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:15.317357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48120d72-7830-4822-8107-624a9e218875 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:15.330333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-48120d72-7830-4822-8107-624a9e218875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:15.356313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:15.357352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:15.358337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:15.358337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:15.358337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:15.358337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:15.361245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 352/714] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:15.367139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48120d72-7830-4822-8107-624a9e218875 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:15.414267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1a30e-c4f9-4d74-b362-2882c76ef7eb None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:15.451664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e1b1f-008c-452d-b8e7-8945b09a0ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:15.452312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e1b1f-008c-452d-b8e7-8945b09a0ffd None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:15.452657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e1b1f-008c-452d-b8e7-8945b09a0ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:15.452906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e1b1f-008c-452d-b8e7-8945b09a0ffd None admin] PATH_INFO: `/v3/services/network` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:15.453540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e1b1f-008c-452d-b8e7-8945b09a0ffd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:15.455086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e1b1f-008c-452d-b8e7-8945b09a0ffd None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:15.462754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-734e1b1f-008c-452d-b8e7-8945b09a0ffd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:15.466571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:15.467624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:15.468526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 363/715] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:15 2022] GET /identity/v3/services/network => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:15.474364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e1b1f-008c-452d-b8e7-8945b09a0ffd None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:15.488955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48120d72-7830-4822-8107-624a9e218875 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:15.529885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72734cf-9c96-4b8b-9262-fa5bce73b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:15.530888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72734cf-9c96-4b8b-9262-fa5bce73b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:15.531335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72734cf-9c96-4b8b-9262-fa5bce73b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:15.531772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72734cf-9c96-4b8b-9262-fa5bce73b0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:15.535193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72734cf-9c96-4b8b-9262-fa5bce73b0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:15.535193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72734cf-9c96-4b8b-9262-fa5bce73b0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:15.535193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72734cf-9c96-4b8b-9262-fa5bce73b0c7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:15.549700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 353/716] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:15.555833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72734cf-9c96-4b8b-9262-fa5bce73b0c7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:15.662753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e1b1f-008c-452d-b8e7-8945b09a0ffd None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:15.665308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72734cf-9c96-4b8b-9262-fa5bce73b0c7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:15.678189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:15.705973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf47d5-4759-4d70-9562-4d3c6bfeba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:15.706605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf47d5-4759-4d70-9562-4d3c6bfeba92 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:15.706873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf47d5-4759-4d70-9562-4d3c6bfeba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:15.707147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf47d5-4759-4d70-9562-4d3c6bfeba92 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:15.707646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0c17b-079f-4e97-b6d3-ccdc585ec47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:15.707867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf47d5-4759-4d70-9562-4d3c6bfeba92 None admin] RBAC: Adding query filter params (name=network) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:15.708118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf47d5-4759-4d70-9562-4d3c6bfeba92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:15.709007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0c17b-079f-4e97-b6d3-ccdc585ec47b None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:15.709511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0c17b-079f-4e97-b6d3-ccdc585ec47b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:15.709680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf47d5-4759-4d70-9562-4d3c6bfeba92 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:15.710133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0c17b-079f-4e97-b6d3-ccdc585ec47b None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:15.711103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0c17b-079f-4e97-b6d3-ccdc585ec47b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:15.712725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0c17b-079f-4e97-b6d3-ccdc585ec47b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:15.714536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 364/717] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:15.720568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf47d5-4759-4d70-9562-4d3c6bfeba92 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:15.825505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf47d5-4759-4d70-9562-4d3c6bfeba92 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:15.861295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85e178-0f69-45b4-a200-30b433fdf3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:15.861924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85e178-0f69-45b4-a200-30b433fdf3ac None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:15.862208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85e178-0f69-45b4-a200-30b433fdf3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:15.862535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85e178-0f69-45b4-a200-30b433fdf3ac None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:15.863214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85e178-0f69-45b4-a200-30b433fdf3ac None admin] RBAC: Adding query filter params (type=network) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:15.863516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85e178-0f69-45b4-a200-30b433fdf3ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:15.864995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85e178-0f69-45b4-a200-30b433fdf3ac None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:15.870937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 365/718] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:15.878102 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:15.892985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 354/719] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:48:15 2022] POST /identity/v3/users => generated 254 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:16.377261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c2762-681f-4d3b-87fb-fdc1642803f6 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:16.378128 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c2762-681f-4d3b-87fb-fdc1642803f6 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:16.378411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c2762-681f-4d3b-87fb-fdc1642803f6 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:16.379946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 366/720] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:16.386017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad121eb-68e3-4866-8954-995d239f6d7a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:16.386887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad121eb-68e3-4866-8954-995d239f6d7a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:16.387693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad121eb-68e3-4866-8954-995d239f6d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:16.409542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6ad121eb-68e3-4866-8954-995d239f6d7a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:16.411141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6ad121eb-68e3-4866-8954-995d239f6d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:16.492929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 355/721] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:16.529766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c2762-681f-4d3b-87fb-fdc1642803f6 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:16.588328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:16.678359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c2762-681f-4d3b-87fb-fdc1642803f6 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:16.716296 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c93e3-171c-4682-9fad-61b59a084464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:16.716962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c93e3-171c-4682-9fad-61b59a084464 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:16.717241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c93e3-171c-4682-9fad-61b59a084464 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:16.717511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c93e3-171c-4682-9fad-61b59a084464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:16.730228 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c93e3-171c-4682-9fad-61b59a084464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-294c93e3-171c-4682-9fad-61b59a084464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:16.735362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:16.736306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:16.737198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:16.740036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 367/722] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:16.743197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad121eb-68e3-4866-8954-995d239f6d7a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:16.862210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad121eb-68e3-4866-8954-995d239f6d7a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:16.900803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:16.909973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362d52b-0fb4-4bbd-9d6e-42fa206af87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:16.910586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362d52b-0fb4-4bbd-9d6e-42fa206af87a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:16.917545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362d52b-0fb4-4bbd-9d6e-42fa206af87a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:16.917545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362d52b-0fb4-4bbd-9d6e-42fa206af87a None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:16.917545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362d52b-0fb4-4bbd-9d6e-42fa206af87a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:16.917545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362d52b-0fb4-4bbd-9d6e-42fa206af87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:16.917545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362d52b-0fb4-4bbd-9d6e-42fa206af87a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:16.924726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 356/723] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:16.930416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c93e3-171c-4682-9fad-61b59a084464 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:16.999948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5e011-ab1c-46eb-b040-b5fcb55957a2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.000240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5e011-ab1c-46eb-b040-b5fcb55957a2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.000411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5e011-ab1c-46eb-b040-b5fcb55957a2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.002411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 357/724] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:17.007861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57b0ad-b3cd-4382-84a2-fef18dc71f4c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.008152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57b0ad-b3cd-4382-84a2-fef18dc71f4c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.008428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57b0ad-b3cd-4382-84a2-fef18dc71f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.040817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bb57b0ad-b3cd-4382-84a2-fef18dc71f4c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:17.042355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bb57b0ad-b3cd-4382-84a2-fef18dc71f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:17.101390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:17.107517 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c93e3-171c-4682-9fad-61b59a084464 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:17.184083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 358/725] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 17:48:17.185656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a9bf7-8efd-4250-8ec9-c34bc3d2ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:17.186665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a9bf7-8efd-4250-8ec9-c34bc3d2ff0e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.187029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a9bf7-8efd-4250-8ec9-c34bc3d2ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.187316 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a9bf7-8efd-4250-8ec9-c34bc3d2ff0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.202230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a9bf7-8efd-4250-8ec9-c34bc3d2ff0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:17.203682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a9bf7-8efd-4250-8ec9-c34bc3d2ff0e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-157a9bf7-8efd-4250-8ec9-c34bc3d2ff0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:17.221718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:17.222715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:17.223582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:17.223582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:17.223582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:17.223582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:17.227609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 368/726] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:17.228976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57b0ad-b3cd-4382-84a2-fef18dc71f4c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.246635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a9bf7-8efd-4250-8ec9-c34bc3d2ff0e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.406814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57b0ad-b3cd-4382-84a2-fef18dc71f4c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:17.433178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:17.447115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab575227-15cd-4c3c-b5be-d5c6f0479f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:17.447764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575227-15cd-4c3c-b5be-d5c6f0479f8e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.448048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575227-15cd-4c3c-b5be-d5c6f0479f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.448323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575227-15cd-4c3c-b5be-d5c6f0479f8e None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.450636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab575227-15cd-4c3c-b5be-d5c6f0479f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:17.450636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab575227-15cd-4c3c-b5be-d5c6f0479f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:17.450987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab575227-15cd-4c3c-b5be-d5c6f0479f8e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:17.463806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 359/727] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:17.469000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab575227-15cd-4c3c-b5be-d5c6f0479f8e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.487421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a9bf7-8efd-4250-8ec9-c34bc3d2ff0e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:17.569871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a3da1-3a1a-41bf-a6da-3b1abf409cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:17.570916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a3da1-3a1a-41bf-a6da-3b1abf409cbf None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.571410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a3da1-3a1a-41bf-a6da-3b1abf409cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.571903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a3da1-3a1a-41bf-a6da-3b1abf409cbf None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.580982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab575227-15cd-4c3c-b5be-d5c6f0479f8e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:17.581533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a3da1-3a1a-41bf-a6da-3b1abf409cbf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:17.583153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a3da1-3a1a-41bf-a6da-3b1abf409cbf None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:17.617761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960cad6-4949-47cb-92d6-ac6fe6ceb439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:17.618457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cad6-4949-47cb-92d6-ac6fe6ceb439 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.618739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cad6-4949-47cb-92d6-ac6fe6ceb439 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.619017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960cad6-4949-47cb-92d6-ac6fe6ceb439 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.628282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960cad6-4949-47cb-92d6-ac6fe6ceb439 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:17.629797 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960cad6-4949-47cb-92d6-ac6fe6ceb439 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-3960cad6-4949-47cb-92d6-ac6fe6ceb439 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:17.641360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:17.642829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:17.643754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 360/728] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:17.649031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960cad6-4949-47cb-92d6-ac6fe6ceb439 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.696886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:17.699705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 369/729] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:48:17 2022] POST /identity/v3/services => generated 251 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:17.751996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff62f6-d61f-4353-8417-32cbf1aae808 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.752323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff62f6-d61f-4353-8417-32cbf1aae808 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.752655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff62f6-d61f-4353-8417-32cbf1aae808 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.758577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 370/730] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:17.764489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afde58-e6fd-4888-b634-4cf0f0a1f441 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.764848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afde58-e6fd-4888-b634-4cf0f0a1f441 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.765129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afde58-e6fd-4888-b634-4cf0f0a1f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.770253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960cad6-4949-47cb-92d6-ac6fe6ceb439 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:17.805988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b1afde58-e6fd-4888-b634-4cf0f0a1f441 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:17.807218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b1afde58-e6fd-4888-b634-4cf0f0a1f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:17.810654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:17.838372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6703d-b057-498d-9600-4bd02b3cd9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:17.840031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6703d-b057-498d-9600-4bd02b3cd9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:17.840031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6703d-b057-498d-9600-4bd02b3cd9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:17.840031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6703d-b057-498d-9600-4bd02b3cd9f0 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:17.840467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6703d-b057-498d-9600-4bd02b3cd9f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:17.840796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6703d-b057-498d-9600-4bd02b3cd9f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:17.842261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6703d-b057-498d-9600-4bd02b3cd9f0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:17.868138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 361/731] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 28 17:48:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:17.869580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6703d-b057-498d-9600-4bd02b3cd9f0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.905728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 371/732] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:17.930344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afde58-e6fd-4888-b634-4cf0f0a1f441 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:17.996846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:18.004751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6703d-b057-498d-9600-4bd02b3cd9f0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:18.038747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7becf8-b9c4-4247-993e-3d2aab154ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:18.039609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7becf8-b9c4-4247-993e-3d2aab154ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.040066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7becf8-b9c4-4247-993e-3d2aab154ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.040518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7becf8-b9c4-4247-993e-3d2aab154ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.045360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afde58-e6fd-4888-b634-4cf0f0a1f441 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:18.089864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e130e0-13bf-4d66-a7cb-f53658d65f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:18.090698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e130e0-13bf-4d66-a7cb-f53658d65f54 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.091038 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e130e0-13bf-4d66-a7cb-f53658d65f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.091399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e130e0-13bf-4d66-a7cb-f53658d65f54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.113106 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:18.116622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e130e0-13bf-4d66-a7cb-f53658d65f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-c2e130e0-13bf-4d66-a7cb-f53658d65f54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:18.126413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:18.128616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:18.129550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 372/733] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:18.136209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e130e0-13bf-4d66-a7cb-f53658d65f54 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:18.142506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7becf8-b9c4-4247-993e-3d2aab154ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:18.144051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7becf8-b9c4-4247-993e-3d2aab154ab5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:18.325232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:18.335182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e130e0-13bf-4d66-a7cb-f53658d65f54 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:18.339603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 362/734] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 17:48:18.356115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7becf8-b9c4-4247-993e-3d2aab154ab5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:18.415595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7f4d8-3531-4e20-94cd-ff5809bb92ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:18.416219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f4d8-3531-4e20-94cd-ff5809bb92ca None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.416499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f4d8-3531-4e20-94cd-ff5809bb92ca None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.416772 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f4d8-3531-4e20-94cd-ff5809bb92ca None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.417527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7f4d8-3531-4e20-94cd-ff5809bb92ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:18.417834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7f4d8-3531-4e20-94cd-ff5809bb92ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:18.419210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7f4d8-3531-4e20-94cd-ff5809bb92ca None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:18.442251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 373/735] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:18.443572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7f4d8-3531-4e20-94cd-ff5809bb92ca None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:18.500767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7becf8-b9c4-4247-993e-3d2aab154ab5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:18.541913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bef97f-1731-42c8-8684-2ad94c735397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:18.542613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bef97f-1731-42c8-8684-2ad94c735397 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.542891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bef97f-1731-42c8-8684-2ad94c735397 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.543163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bef97f-1731-42c8-8684-2ad94c735397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.555271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bef97f-1731-42c8-8684-2ad94c735397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:18.556759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bef97f-1731-42c8-8684-2ad94c735397 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d1bef97f-1731-42c8-8684-2ad94c735397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:18.576199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:18.577129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:18.586738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:18.586738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:18.586738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:18.586738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:18.586738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 363/736] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:18.586738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cd6bf-9694-41e9-b380-149a9e53ee68 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.586738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cd6bf-9694-41e9-b380-149a9e53ee68 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.586738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cd6bf-9694-41e9-b380-149a9e53ee68 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.586738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 364/737] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:18.587233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cd6bf-9694-41e9-b380-149a9e53ee68 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:18.635054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:18.657076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:18.698892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7f4d8-3531-4e20-94cd-ff5809bb92ca None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:18.699232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cd6bf-9694-41e9-b380-149a9e53ee68 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:18.736101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed359f0b-ad17-4a8c-9c9a-d4ce0ccc4081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:18.736762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359f0b-ad17-4a8c-9c9a-d4ce0ccc4081 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.737085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359f0b-ad17-4a8c-9c9a-d4ce0ccc4081 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.737364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed359f0b-ad17-4a8c-9c9a-d4ce0ccc4081 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.738137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed359f0b-ad17-4a8c-9c9a-d4ce0ccc4081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:18.738445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed359f0b-ad17-4a8c-9c9a-d4ce0ccc4081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:18.738685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d40d8-e162-47ef-9f84-5383e66fd261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:18.739345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d40d8-e162-47ef-9f84-5383e66fd261 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.739609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d40d8-e162-47ef-9f84-5383e66fd261 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.739883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d40d8-e162-47ef-9f84-5383e66fd261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.740001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed359f0b-ad17-4a8c-9c9a-d4ce0ccc4081 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:18.753430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d40d8-e162-47ef-9f84-5383e66fd261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:18.753589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 365/738] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:18.754534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801ee48-5667-49ec-a291-3bfc0663db14 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.754824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801ee48-5667-49ec-a291-3bfc0663db14 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.755098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801ee48-5667-49ec-a291-3bfc0663db14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.758994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d40d8-e162-47ef-9f84-5383e66fd261 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:18.773632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b801ee48-5667-49ec-a291-3bfc0663db14 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-cb3d40d8-e162-47ef-9f84-5383e66fd261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:18.774748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:18.775595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:18.776523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:18.776523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:18.776523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:18.776523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:18.776740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b801ee48-5667-49ec-a291-3bfc0663db14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:18.780297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 374/739] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:18.781835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1e05-f06d-4451-a598-9d73a4928b8d None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.782150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1e05-f06d-4451-a598-9d73a4928b8d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.782430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1e05-f06d-4451-a598-9d73a4928b8d None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.783842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 375/740] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:18.784459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc1e05-f06d-4451-a598-9d73a4928b8d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:18.849460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 366/741] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:18.850283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801ee48-5667-49ec-a291-3bfc0663db14 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:18.891182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:18.901060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc1e05-f06d-4451-a598-9d73a4928b8d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:18.916473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:18.936680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df7fb3-9210-4c15-a0c5-3d3e473e486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:18.937348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df7fb3-9210-4c15-a0c5-3d3e473e486b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.937886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df7fb3-9210-4c15-a0c5-3d3e473e486b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.937996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df7fb3-9210-4c15-a0c5-3d3e473e486b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.944770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df7fb3-9210-4c15-a0c5-3d3e473e486b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:18.946315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df7fb3-9210-4c15-a0c5-3d3e473e486b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-95df7fb3-9210-4c15-a0c5-3d3e473e486b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:18.958444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:18.959364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:18.960333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:18.960333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:18.960333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:18.960333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:18.960333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:18.960333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:18.960333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:18.960333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:18.967728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 376/742] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:18.967884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801ee48-5667-49ec-a291-3bfc0663db14 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:18.967980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7bc0-dea4-4ce0-90e0-4a5e9cb3b2da None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:18.967980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7bc0-dea4-4ce0-90e0-4a5e9cb3b2da None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:18.967980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7bc0-dea4-4ce0-90e0-4a5e9cb3b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:18.983022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-092d7bc0-dea4-4ce0-90e0-4a5e9cb3b2da None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:18.984489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-092d7bc0-dea4-4ce0-90e0-4a5e9cb3b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:19.004306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed34c0-0b6b-44f5-b607-9d51486c7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:19.004971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed34c0-0b6b-44f5-b607-9d51486c7b0c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.005254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed34c0-0b6b-44f5-b607-9d51486c7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.005525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed34c0-0b6b-44f5-b607-9d51486c7b0c None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.006246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed34c0-0b6b-44f5-b607-9d51486c7b0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:19.006550 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed34c0-0b6b-44f5-b607-9d51486c7b0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:19.007909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed34c0-0b6b-44f5-b607-9d51486c7b0c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:19.023969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 367/743] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:19.023969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed34c0-0b6b-44f5-b607-9d51486c7b0c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:19.068804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 377/744] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 17:48:19.068804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7bc0-dea4-4ce0-90e0-4a5e9cb3b2da None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:19.135079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:19.141939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed34c0-0b6b-44f5-b607-9d51486c7b0c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:19.182282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7bc0-dea4-4ce0-90e0-4a5e9cb3b2da None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:19.185785 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:19.188950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70aa570-9536-4193-ad2c-4e1feb83be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:19.189586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aa570-9536-4193-ad2c-4e1feb83be0c None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.189868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aa570-9536-4193-ad2c-4e1feb83be0c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.190138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aa570-9536-4193-ad2c-4e1feb83be0c None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.190838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70aa570-9536-4193-ad2c-4e1feb83be0c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:19.192223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70aa570-9536-4193-ad2c-4e1feb83be0c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:19.220802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7639-906e-417f-b0cb-1acc19dc4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:19.221414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7639-906e-417f-b0cb-1acc19dc4fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.221694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7639-906e-417f-b0cb-1acc19dc4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.221965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7639-906e-417f-b0cb-1acc19dc4fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.222711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7639-906e-417f-b0cb-1acc19dc4fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:19.223016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7639-906e-417f-b0cb-1acc19dc4fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:19.224436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7639-906e-417f-b0cb-1acc19dc4fd9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:19.236273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 378/745] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:19.237068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7639-906e-417f-b0cb-1acc19dc4fd9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:19.316761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 368/746] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:48:19 2022] POST /identity/v3/services => generated 240 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:19.317818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70aa570-9536-4193-ad2c-4e1feb83be0c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:19.357630 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7639-906e-417f-b0cb-1acc19dc4fd9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:19.419541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2045633-7941-451e-8c44-5009a1df3a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:19.420292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2045633-7941-451e-8c44-5009a1df3a7e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.420655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2045633-7941-451e-8c44-5009a1df3a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.421590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2045633-7941-451e-8c44-5009a1df3a7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.433955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2045633-7941-451e-8c44-5009a1df3a7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:19.435820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2045633-7941-451e-8c44-5009a1df3a7e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:19.444055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70aa570-9536-4193-ad2c-4e1feb83be0c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d2045633-7941-451e-8c44-5009a1df3a7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:19.453447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:19.454534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:19.455498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:19.457212 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 379/747] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 28 17:48:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:19.457847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2045633-7941-451e-8c44-5009a1df3a7e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:19.485023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:19.499260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529a31e-7150-4ac2-9ca7-eae57c0510cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:19.500153 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529a31e-7150-4ac2-9ca7-eae57c0510cd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.500432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529a31e-7150-4ac2-9ca7-eae57c0510cd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.500706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529a31e-7150-4ac2-9ca7-eae57c0510cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.520088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529a31e-7150-4ac2-9ca7-eae57c0510cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:19.589995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2045633-7941-451e-8c44-5009a1df3a7e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2529a31e-7150-4ac2-9ca7-eae57c0510cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:19.646764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:19.647829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 369/748] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:19.649129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529a31e-7150-4ac2-9ca7-eae57c0510cd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:19.657782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5f3c7-abe5-4ad0-a91a-9539490c2f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:19.658407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f3c7-abe5-4ad0-a91a-9539490c2f63 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.658682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f3c7-abe5-4ad0-a91a-9539490c2f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.658955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5f3c7-abe5-4ad0-a91a-9539490c2f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.659816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5f3c7-abe5-4ad0-a91a-9539490c2f63 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=38bd83f5a0bc4e7ea5cde1972c44503b) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:19.660131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5f3c7-abe5-4ad0-a91a-9539490c2f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:19.661634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5f3c7-abe5-4ad0-a91a-9539490c2f63 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:19.668023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 380/749] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:19 2022] GET /identity/v3/role_assignments?user.id=38bd83f5a0bc4e7ea5cde1972c44503b&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:19.669065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5f3c7-abe5-4ad0-a91a-9539490c2f63 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:19.672060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:19.815012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:19.837881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529a31e-7150-4ac2-9ca7-eae57c0510cd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:19.859139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5f3c7-abe5-4ad0-a91a-9539490c2f63 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:19.902903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3caa07-fb63-47de-97cd-6749bfb40bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:19.903136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3caa07-fb63-47de-97cd-6749bfb40bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.903362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3caa07-fb63-47de-97cd-6749bfb40bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.903622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3caa07-fb63-47de-97cd-6749bfb40bf7 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.904690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3caa07-fb63-47de-97cd-6749bfb40bf7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:19.905051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3caa07-fb63-47de-97cd-6749bfb40bf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:19.906880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3caa07-fb63-47de-97cd-6749bfb40bf7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:19.909019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7070173-56c5-492b-a0ac-c43df0f4a6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:19.910129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7070173-56c5-492b-a0ac-c43df0f4a6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:19.911146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7070173-56c5-492b-a0ac-c43df0f4a6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:19.911274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7070173-56c5-492b-a0ac-c43df0f4a6d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:19.912021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7070173-56c5-492b-a0ac-c43df0f4a6d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:19.912335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7070173-56c5-492b-a0ac-c43df0f4a6d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:19.913755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7070173-56c5-492b-a0ac-c43df0f4a6d8 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:19.930077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 370/750] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 28 17:48:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:19.934758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 381/751] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:19.934900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3caa07-fb63-47de-97cd-6749bfb40bf7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:19.935806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7070173-56c5-492b-a0ac-c43df0f4a6d8 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.056834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.087236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3caa07-fb63-47de-97cd-6749bfb40bf7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.114135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7070173-56c5-492b-a0ac-c43df0f4a6d8 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.132324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be40589-0c7d-4844-8e52-9331b5974b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.133265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40589-0c7d-4844-8e52-9331b5974b77 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.133546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40589-0c7d-4844-8e52-9331b5974b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.133819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40589-0c7d-4844-8e52-9331b5974b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.147905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be40589-0c7d-4844-8e52-9331b5974b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.149914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be40589-0c7d-4844-8e52-9331b5974b77 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.155462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0009f-76e0-4479-b3bb-e2f0263685bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.156170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0009f-76e0-4479-b3bb-e2f0263685bb None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.156520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0009f-76e0-4479-b3bb-e2f0263685bb None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.156891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0009f-76e0-4479-b3bb-e2f0263685bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1be40589-0c7d-4844-8e52-9331b5974b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:20.166950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:20.167867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:20.168762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:20.168762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:20.168762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:20.168762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:20.174523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 371/752] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:20.174523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9aa59-75ed-497c-a29d-10ec2d926eed None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.175291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9aa59-75ed-497c-a29d-10ec2d926eed None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.179260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9aa59-75ed-497c-a29d-10ec2d926eed None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.179260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 372/753] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:20.179260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9aa59-75ed-497c-a29d-10ec2d926eed None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.183970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0009f-76e0-4479-b3bb-e2f0263685bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.185471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0009f-76e0-4479-b3bb-e2f0263685bb None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.194716 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-1ca0009f-76e0-4479-b3bb-e2f0263685bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:20.204996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:20.210089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:20.211246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:20.211246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:20.211246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:20.211246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:20.211246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 382/754] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:20.211246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4dfaa-b487-41b5-8b68-40a93e2d5db8 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.211246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4dfaa-b487-41b5-8b68-40a93e2d5db8 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.211246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4dfaa-b487-41b5-8b68-40a93e2d5db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.231612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2da4dfaa-b487-41b5-8b68-40a93e2d5db8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:20.233292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2da4dfaa-b487-41b5-8b68-40a93e2d5db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:20.307375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9aa59-75ed-497c-a29d-10ec2d926eed None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.333262 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 383/755] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:20.334075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4dfaa-b487-41b5-8b68-40a93e2d5db8 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.341137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.348439 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cc629-95d1-4938-96a7-52f53e4200bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.349384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cc629-95d1-4938-96a7-52f53e4200bb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.349884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cc629-95d1-4938-96a7-52f53e4200bb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.350356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cc629-95d1-4938-96a7-52f53e4200bb None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.351245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cc629-95d1-4938-96a7-52f53e4200bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:20.358130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cc629-95d1-4938-96a7-52f53e4200bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.358130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cc629-95d1-4938-96a7-52f53e4200bb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.369537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 373/756] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:20.370613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cc629-95d1-4938-96a7-52f53e4200bb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.465929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4dfaa-b487-41b5-8b68-40a93e2d5db8 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.499549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.502217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cc629-95d1-4938-96a7-52f53e4200bb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.510302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091553-daf5-429b-bce9-7ccb9804ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.511182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091553-daf5-429b-bce9-7ccb9804ee02 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.511988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091553-daf5-429b-bce9-7ccb9804ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.512429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091553-daf5-429b-bce9-7ccb9804ee02 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.517502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091553-daf5-429b-bce9-7ccb9804ee02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:20.517502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091553-daf5-429b-bce9-7ccb9804ee02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.517502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091553-daf5-429b-bce9-7ccb9804ee02 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.531422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 384/757] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:20.534637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091553-daf5-429b-bce9-7ccb9804ee02 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.540448 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df559-bc16-488a-b841-098ed948b60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.551886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df559-bc16-488a-b841-098ed948b60a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.551886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df559-bc16-488a-b841-098ed948b60a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.551886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df559-bc16-488a-b841-098ed948b60a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.551886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17df559-bc16-488a-b841-098ed948b60a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.551886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17df559-bc16-488a-b841-098ed948b60a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d17df559-bc16-488a-b841-098ed948b60a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:20.558629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:20.559586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:48:20.561251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:20.565404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 374/758] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:20.566283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df559-bc16-488a-b841-098ed948b60a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.636947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.659965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091553-daf5-429b-bce9-7ccb9804ee02 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.689738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df559-bc16-488a-b841-098ed948b60a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.697765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e8866-0954-43ad-9e4c-119b06ecea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.698651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e8866-0954-43ad-9e4c-119b06ecea5b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.699158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e8866-0954-43ad-9e4c-119b06ecea5b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.699569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e8866-0954-43ad-9e4c-119b06ecea5b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.708363 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e8866-0954-43ad-9e4c-119b06ecea5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.709995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e8866-0954-43ad-9e4c-119b06ecea5b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d10e8866-0954-43ad-9e4c-119b06ecea5b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:20.722121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:20.723189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:20.724282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:20.724833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39012bb-8100-4a8e-ba3f-d93e9bab9f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.725334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39012bb-8100-4a8e-ba3f-d93e9bab9f0b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.725663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39012bb-8100-4a8e-ba3f-d93e9bab9f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.725943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39012bb-8100-4a8e-ba3f-d93e9bab9f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.726859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 385/759] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:20.727763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e8866-0954-43ad-9e4c-119b06ecea5b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.737957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39012bb-8100-4a8e-ba3f-d93e9bab9f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.739445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39012bb-8100-4a8e-ba3f-d93e9bab9f0b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c39012bb-8100-4a8e-ba3f-d93e9bab9f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:20.752368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:20.753486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:20.754522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:20.754522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:20.754522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:20.754522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:20.754522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:20.754522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:20.754522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:20.754522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:20.754522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 375/760] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:20.755041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39012bb-8100-4a8e-ba3f-d93e9bab9f0b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.785962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.840024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e8866-0954-43ad-9e4c-119b06ecea5b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.863042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39012bb-8100-4a8e-ba3f-d93e9bab9f0b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:20.874310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:20.878161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b98ad4-a88f-4859-9093-36bc49647f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.878958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b98ad4-a88f-4859-9093-36bc49647f37 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.879378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b98ad4-a88f-4859-9093-36bc49647f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.879790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b98ad4-a88f-4859-9093-36bc49647f37 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.880677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b98ad4-a88f-4859-9093-36bc49647f37 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:20.881153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b98ad4-a88f-4859-9093-36bc49647f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.882750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b98ad4-a88f-4859-9093-36bc49647f37 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.887859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 386/761] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:20.890258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b98ad4-a88f-4859-9093-36bc49647f37 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.904815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28378d1-060f-49b2-9f76-2833770174d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:20.905435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28378d1-060f-49b2-9f76-2833770174d2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:20.905722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28378d1-060f-49b2-9f76-2833770174d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:20.906001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28378d1-060f-49b2-9f76-2833770174d2 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:20.906803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28378d1-060f-49b2-9f76-2833770174d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:20.907140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28378d1-060f-49b2-9f76-2833770174d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:20.908836 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28378d1-060f-49b2-9f76-2833770174d2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:20.935569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 376/762] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:20.936616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28378d1-060f-49b2-9f76-2833770174d2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:20.998059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b98ad4-a88f-4859-9093-36bc49647f37 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.011912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.034313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7568-ccbd-4413-aca8-e027193bf0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.035187 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7568-ccbd-4413-aca8-e027193bf0ea None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.035606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7568-ccbd-4413-aca8-e027193bf0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.036014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7568-ccbd-4413-aca8-e027193bf0ea None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.037025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7568-ccbd-4413-aca8-e027193bf0ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:21.037582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7568-ccbd-4413-aca8-e027193bf0ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.039142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7568-ccbd-4413-aca8-e027193bf0ea None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.046549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28378d1-060f-49b2-9f76-2833770174d2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.053045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 387/763] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:21.054216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7568-ccbd-4413-aca8-e027193bf0ea None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.086827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ef2a-4e9d-4691-99ae-eef2130f599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.087402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ef2a-4e9d-4691-99ae-eef2130f599e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.087689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ef2a-4e9d-4691-99ae-eef2130f599e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.087982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ef2a-4e9d-4691-99ae-eef2130f599e None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.088632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308ef2a-4e9d-4691-99ae-eef2130f599e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:21.089080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308ef2a-4e9d-4691-99ae-eef2130f599e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.090631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308ef2a-4e9d-4691-99ae-eef2130f599e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.100544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 377/764] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 28 17:48:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:21.101625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ef2a-4e9d-4691-99ae-eef2130f599e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.138656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.172683 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7568-ccbd-4413-aca8-e027193bf0ea None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.211795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e50201-095c-4c77-8860-36e09a86d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.212416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e50201-095c-4c77-8860-36e09a86d59b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.212997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e50201-095c-4c77-8860-36e09a86d59b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.212997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e50201-095c-4c77-8860-36e09a86d59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.222983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ef2a-4e9d-4691-99ae-eef2130f599e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.259468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.265214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67922c-93aa-46c6-904f-903bfb1f5963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.265705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67922c-93aa-46c6-904f-903bfb1f5963 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.266090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67922c-93aa-46c6-904f-903bfb1f5963 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.270878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67922c-93aa-46c6-904f-903bfb1f5963 None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/cb85b3e1dc464438ac007c1b09ea7fd3/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.270878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67922c-93aa-46c6-904f-903bfb1f5963 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=cb85b3e1dc464438ac007c1b09ea7fd3, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.270878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67922c-93aa-46c6-904f-903bfb1f5963 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.287621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e50201-095c-4c77-8860-36e09a86d59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.289097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e50201-095c-4c77-8860-36e09a86d59b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.389512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 378/765] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:21 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/cb85b3e1dc464438ac007c1b09ea7fd3/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:21.392323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67922c-93aa-46c6-904f-903bfb1f5963 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.403443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 388/766] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:21.413356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e50201-095c-4c77-8860-36e09a86d59b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.557208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.564015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.577721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67922c-93aa-46c6-904f-903bfb1f5963 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.591765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e50201-095c-4c77-8860-36e09a86d59b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.629520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaa757-1277-49f9-bc67-0c4dd47378d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.629726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaa757-1277-49f9-bc67-0c4dd47378d7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.629938 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaa757-1277-49f9-bc67-0c4dd47378d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.630131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaa757-1277-49f9-bc67-0c4dd47378d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.642073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaa757-1277-49f9-bc67-0c4dd47378d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.643521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaa757-1277-49f9-bc67-0c4dd47378d7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-a6eaa757-1277-49f9-bc67-0c4dd47378d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:21.661867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:21.663274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:21.664275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:21.664275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:21.664275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:21.664275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:21.666522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 389/767] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:21.668543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce82b-1671-4ec0-84b3-6d5747537686 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.669408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce82b-1671-4ec0-84b3-6d5747537686 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.669829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce82b-1671-4ec0-84b3-6d5747537686 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.676413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 390/768] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:21.676413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce82b-1671-4ec0-84b3-6d5747537686 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.697969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e504d35-b9d6-42c5-98f0-6e47dc535df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.698926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e504d35-b9d6-42c5-98f0-6e47dc535df2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.699212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e504d35-b9d6-42c5-98f0-6e47dc535df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.699489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e504d35-b9d6-42c5-98f0-6e47dc535df2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.700257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e504d35-b9d6-42c5-98f0-6e47dc535df2 None admin] RBAC: Adding query filter params (interface=public, service_id=0d72dac5e29e49aea5c8fddb7f8295d8, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:21.700570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e504d35-b9d6-42c5-98f0-6e47dc535df2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.702463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e504d35-b9d6-42c5-98f0-6e47dc535df2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.713441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 379/769] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/endpoints?service_id=0d72dac5e29e49aea5c8fddb7f8295d8&interface=public®ion_id=RegionOne => generated 194 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:21.714993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f482e-5dd4-4732-8a54-04e11a8de387 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.715276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f482e-5dd4-4732-8a54-04e11a8de387 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.715548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f482e-5dd4-4732-8a54-04e11a8de387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.737876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ea9f482e-5dd4-4732-8a54-04e11a8de387 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:21.739351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ea9f482e-5dd4-4732-8a54-04e11a8de387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:21.804693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce82b-1671-4ec0-84b3-6d5747537686 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.830207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.836971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 380/770] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:21.836971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f482e-5dd4-4732-8a54-04e11a8de387 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.865587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e4026-7017-494e-beed-be4c89ba51a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.866615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e4026-7017-494e-beed-be4c89ba51a5 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.867102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e4026-7017-494e-beed-be4c89ba51a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.867585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e4026-7017-494e-beed-be4c89ba51a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.868347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e4026-7017-494e-beed-be4c89ba51a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:21.868651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e4026-7017-494e-beed-be4c89ba51a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.870308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e4026-7017-494e-beed-be4c89ba51a5 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.885204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 391/771] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:21.888897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e4026-7017-494e-beed-be4c89ba51a5 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:21.936822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:21.951701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f482e-5dd4-4732-8a54-04e11a8de387 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:21.988696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a7a9-fdfe-4127-82fc-5988a97fc8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:21.989341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a7a9-fdfe-4127-82fc-5988a97fc8ff None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:21.989667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a7a9-fdfe-4127-82fc-5988a97fc8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:21.989940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a7a9-fdfe-4127-82fc-5988a97fc8ff None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:21.990631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896a7a9-fdfe-4127-82fc-5988a97fc8ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:21.991991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896a7a9-fdfe-4127-82fc-5988a97fc8ff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:21.996254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e4026-7017-494e-beed-be4c89ba51a5 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.004829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 381/772] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:22.004829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cef38-2707-4876-abef-a9889b89ee31 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.004829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cef38-2707-4876-abef-a9889b89ee31 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.004829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cef38-2707-4876-abef-a9889b89ee31 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.004829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 382/773] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:22.004829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cef38-2707-4876-abef-a9889b89ee31 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.052542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594a0f6-162d-4707-aa9a-bb2c061b8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.053702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594a0f6-162d-4707-aa9a-bb2c061b8a14 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.054092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594a0f6-162d-4707-aa9a-bb2c061b8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.054470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594a0f6-162d-4707-aa9a-bb2c061b8a14 None admin] PATH_INFO: `/v3/services/network` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.055398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594a0f6-162d-4707-aa9a-bb2c061b8a14 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.057750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594a0f6-162d-4707-aa9a-bb2c061b8a14 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d594a0f6-162d-4707-aa9a-bb2c061b8a14 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:22.071699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:22.072775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:48:22.073641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:22.074387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 392/774] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:21 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:22.076103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deaa72-7a0d-490d-a97e-368d2d13b44c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.076392 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deaa72-7a0d-490d-a97e-368d2d13b44c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.076672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deaa72-7a0d-490d-a97e-368d2d13b44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.104122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-46deaa72-7a0d-490d-a97e-368d2d13b44c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:22.105341 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-46deaa72-7a0d-490d-a97e-368d2d13b44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:22.132911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cef38-2707-4876-abef-a9889b89ee31 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.156272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.200330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f52941-b53c-4dd6-a08c-9cddfeee325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.201110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f52941-b53c-4dd6-a08c-9cddfeee325f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.201361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f52941-b53c-4dd6-a08c-9cddfeee325f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.201661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f52941-b53c-4dd6-a08c-9cddfeee325f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.204500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 393/775] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:22.205749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deaa72-7a0d-490d-a97e-368d2d13b44c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.210871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f52941-b53c-4dd6-a08c-9cddfeee325f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.212330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f52941-b53c-4dd6-a08c-9cddfeee325f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-66f52941-b53c-4dd6-a08c-9cddfeee325f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:22.225050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:22.226043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:22.226921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:22.226921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:22.226921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:22.226921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:22.226921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:22.226921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:22.226921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:22.226921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:22.227848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 383/776] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:22.228487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f52941-b53c-4dd6-a08c-9cddfeee325f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.243031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.322639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deaa72-7a0d-490d-a97e-368d2d13b44c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.344261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f52941-b53c-4dd6-a08c-9cddfeee325f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.363386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2f0ef-8b10-48da-b452-3732e7250c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.364268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f0ef-8b10-48da-b452-3732e7250c0e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.364753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f0ef-8b10-48da-b452-3732e7250c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.365068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2f0ef-8b10-48da-b452-3732e7250c0e None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.365861 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2f0ef-8b10-48da-b452-3732e7250c0e None admin] RBAC: Adding query filter params (name=network) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:22.366170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2f0ef-8b10-48da-b452-3732e7250c0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.367537 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2f0ef-8b10-48da-b452-3732e7250c0e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.374982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 394/777] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:22.375960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2f0ef-8b10-48da-b452-3732e7250c0e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.390785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2079-b670-434d-b487-bfb6406acb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.392410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2079-b670-434d-b487-bfb6406acb27 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.393332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2079-b670-434d-b487-bfb6406acb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.393756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2079-b670-434d-b487-bfb6406acb27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.406575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e2079-b670-434d-b487-bfb6406acb27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c66e2079-b670-434d-b487-bfb6406acb27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:22.412595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:22.413564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:22.414408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:22.417270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 384/778] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:22.418248 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2079-b670-434d-b487-bfb6406acb27 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.423997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.484359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2f0ef-8b10-48da-b452-3732e7250c0e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.511758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.521567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714b42-dbe9-49c3-94d1-642f0fa95b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.522266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714b42-dbe9-49c3-94d1-642f0fa95b15 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.522547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714b42-dbe9-49c3-94d1-642f0fa95b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.527422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714b42-dbe9-49c3-94d1-642f0fa95b15 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.527422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714b42-dbe9-49c3-94d1-642f0fa95b15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:22.527422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714b42-dbe9-49c3-94d1-642f0fa95b15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.527422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714b42-dbe9-49c3-94d1-642f0fa95b15 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.538138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 395/779] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:22.539108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714b42-dbe9-49c3-94d1-642f0fa95b15 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.552078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2079-b670-434d-b487-bfb6406acb27 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.601182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda2afe-7b24-438b-baf4-db09cc03039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.601811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2afe-7b24-438b-baf4-db09cc03039d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.602295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2afe-7b24-438b-baf4-db09cc03039d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.602438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2afe-7b24-438b-baf4-db09cc03039d None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.603644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda2afe-7b24-438b-baf4-db09cc03039d None admin] RBAC: Adding query filter params (type=network) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:22.603943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda2afe-7b24-438b-baf4-db09cc03039d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.605884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda2afe-7b24-438b-baf4-db09cc03039d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.652120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714b42-dbe9-49c3-94d1-642f0fa95b15 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.653837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.657960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 385/780] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:22.658879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda2afe-7b24-438b-baf4-db09cc03039d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.687986 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3094-ce5b-4bf7-a930-5f6fcdf52f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.689376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3094-ce5b-4bf7-a930-5f6fcdf52f31 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.689719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3094-ce5b-4bf7-a930-5f6fcdf52f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.690107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3094-ce5b-4bf7-a930-5f6fcdf52f31 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.690892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae3094-ce5b-4bf7-a930-5f6fcdf52f31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:22.691350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae3094-ce5b-4bf7-a930-5f6fcdf52f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.692969 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae3094-ce5b-4bf7-a930-5f6fcdf52f31 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.703162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 396/781] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:22.704239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3094-ce5b-4bf7-a930-5f6fcdf52f31 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.783903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda2afe-7b24-438b-baf4-db09cc03039d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.821834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf467-91a2-4b7b-9b1b-308cb94b66dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.822596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf467-91a2-4b7b-9b1b-308cb94b66dd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.822943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf467-91a2-4b7b-9b1b-308cb94b66dd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.823383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bf467-91a2-4b7b-9b1b-308cb94b66dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.824263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bf467-91a2-4b7b-9b1b-308cb94b66dd None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=36f4189de0674590a257d9de7a60c63f) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:22.824638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bf467-91a2-4b7b-9b1b-308cb94b66dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.826147 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bf467-91a2-4b7b-9b1b-308cb94b66dd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.826326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3094-ce5b-4bf7-a930-5f6fcdf52f31 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:22.828312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.833290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 386/782] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/role_assignments?user.id=36f4189de0674590a257d9de7a60c63f&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:22.834233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf467-91a2-4b7b-9b1b-308cb94b66dd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.874526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4df1-f6d0-405f-8532-556147eae88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:22.876034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4df1-f6d0-405f-8532-556147eae88f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:22.876034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4df1-f6d0-405f-8532-556147eae88f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:22.876034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4df1-f6d0-405f-8532-556147eae88f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:22.876880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c4df1-f6d0-405f-8532-556147eae88f None admin] RBAC: Adding query filter params (interface=public, service_id=e43ebd9aaf5e41cbac380fea635d6322, region_id=RegionOne) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:22.877450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c4df1-f6d0-405f-8532-556147eae88f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:22.878997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c4df1-f6d0-405f-8532-556147eae88f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:22.887781 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 397/783] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/endpoints?service_id=e43ebd9aaf5e41cbac380fea635d6322&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:22.893615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4df1-f6d0-405f-8532-556147eae88f None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:22.928169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:22.967486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bf467-91a2-4b7b-9b1b-308cb94b66dd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:23.012061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4df1-f6d0-405f-8532-556147eae88f None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:23.012323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fe196-0e2b-4ffc-b9f2-4347a0568b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:23.013078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fe196-0e2b-4ffc-b9f2-4347a0568b2a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:23.013427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fe196-0e2b-4ffc-b9f2-4347a0568b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:23.013763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fe196-0e2b-4ffc-b9f2-4347a0568b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:23.029379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fe196-0e2b-4ffc-b9f2-4347a0568b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:23.031077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fe196-0e2b-4ffc-b9f2-4347a0568b2a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b42fe196-0e2b-4ffc-b9f2-4347a0568b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:23.048798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:23.049946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:23.051047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:23.051047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:23.051047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:23.051047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:23.051998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 387/784] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:23.060519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fe196-0e2b-4ffc-b9f2-4347a0568b2a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:23.073644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f8267-4ed2-44a8-a65a-cfdfbc8ed7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:23.074294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f8267-4ed2-44a8-a65a-cfdfbc8ed7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:23.074583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f8267-4ed2-44a8-a65a-cfdfbc8ed7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:23.074864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f8267-4ed2-44a8-a65a-cfdfbc8ed7b7 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:23.075534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f8267-4ed2-44a8-a65a-cfdfbc8ed7b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:23.077046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f8267-4ed2-44a8-a65a-cfdfbc8ed7b7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:23.091494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 398/785] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 28 17:48:22 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:23.137211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:23.208959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fe196-0e2b-4ffc-b9f2-4347a0568b2a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:23.260574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8748bfc-4ecc-4b31-be50-52468f909b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:23.261231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8748bfc-4ecc-4b31-be50-52468f909b4c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:23.261511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8748bfc-4ecc-4b31-be50-52468f909b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:23.261782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8748bfc-4ecc-4b31-be50-52468f909b4c None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:23.262487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8748bfc-4ecc-4b31-be50-52468f909b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:23.262789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8748bfc-4ecc-4b31-be50-52468f909b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:23.264261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8748bfc-4ecc-4b31-be50-52468f909b4c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:23.282904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 388/786] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:23.288360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f8267-4ed2-44a8-a65a-cfdfbc8ed7b7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:23.390221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:23.401254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f8267-4ed2-44a8-a65a-cfdfbc8ed7b7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:23.440910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3c545-a377-43d1-b6c4-dda4991a2520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:23.441554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3c545-a377-43d1-b6c4-dda4991a2520 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:23.441832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3c545-a377-43d1-b6c4-dda4991a2520 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:23.442103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3c545-a377-43d1-b6c4-dda4991a2520 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:23.450024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3c545-a377-43d1-b6c4-dda4991a2520 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:23.451532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3c545-a377-43d1-b6c4-dda4991a2520 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-89a3c545-a377-43d1-b6c4-dda4991a2520 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:23.463273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:23.464229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:23.465232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 399/787] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:23.474324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8748bfc-4ecc-4b31-be50-52468f909b4c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:23.619593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8748bfc-4ecc-4b31-be50-52468f909b4c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:23.632383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:23.655106 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583d262-623a-4321-9145-e2904c12e9e3 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:23.665371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583d262-623a-4321-9145-e2904c12e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:23.665371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583d262-623a-4321-9145-e2904c12e9e3 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:23.665371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 400/788] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:23.665718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c09d-35f8-4f49-98e9-60a34de7dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:23.665718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c09d-35f8-4f49-98e9-60a34de7dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:23.665718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c09d-35f8-4f49-98e9-60a34de7dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:23.665718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c09d-35f8-4f49-98e9-60a34de7dcc9 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:23.666006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88c09d-35f8-4f49-98e9-60a34de7dcc9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:23.666006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88c09d-35f8-4f49-98e9-60a34de7dcc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:23.666448 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88c09d-35f8-4f49-98e9-60a34de7dcc9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:23.670477 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63f1a-7a02-44dc-8018-329728944725 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:23.670764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63f1a-7a02-44dc-8018-329728944725 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:23.671036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63f1a-7a02-44dc-8018-329728944725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:23.696948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 389/789] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 28 17:48:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:23.700829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c09d-35f8-4f49-98e9-60a34de7dcc9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:23.706547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f5c63f1a-7a02-44dc-8018-329728944725 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:23.708400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f5c63f1a-7a02-44dc-8018-329728944725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:23.807142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 401/790] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:23.858207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63f1a-7a02-44dc-8018-329728944725 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:23.862824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c09d-35f8-4f49-98e9-60a34de7dcc9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:23.913542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7ccb4-f5ae-4612-ac0a-526ce52bec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:23.914196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7ccb4-f5ae-4612-ac0a-526ce52bec7e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:23.914474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7ccb4-f5ae-4612-ac0a-526ce52bec7e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:23.914736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7ccb4-f5ae-4612-ac0a-526ce52bec7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:23.935010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7ccb4-f5ae-4612-ac0a-526ce52bec7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:23.936718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7ccb4-f5ae-4612-ac0a-526ce52bec7e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5cc7ccb4-f5ae-4612-ac0a-526ce52bec7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:23.963584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:23.964537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:23.965482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:23.965482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:23.965482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:23.965482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:23.965482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 390/791] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:23.975352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7ccb4-f5ae-4612-ac0a-526ce52bec7e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.000073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.013874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.020558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63f1a-7a02-44dc-8018-329728944725 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.091437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112166-ad86-43e5-b10d-fd79aa6c0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.092325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112166-ad86-43e5-b10d-fd79aa6c0878 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.093738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112166-ad86-43e5-b10d-fd79aa6c0878 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.094304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112166-ad86-43e5-b10d-fd79aa6c0878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.115255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0112166-ad86-43e5-b10d-fd79aa6c0878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-c0112166-ad86-43e5-b10d-fd79aa6c0878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:24.120493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:24.121633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:24.122651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:24.127739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 402/792] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:24.135902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112166-ad86-43e5-b10d-fd79aa6c0878 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.156812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7ccb4-f5ae-4612-ac0a-526ce52bec7e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.222389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3782f5-1571-461d-a753-33cfb74a1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.223014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3782f5-1571-461d-a753-33cfb74a1a45 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.223283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3782f5-1571-461d-a753-33cfb74a1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.223607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3782f5-1571-461d-a753-33cfb74a1a45 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.224417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3782f5-1571-461d-a753-33cfb74a1a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:24.224867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3782f5-1571-461d-a753-33cfb74a1a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:24.226133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3782f5-1571-461d-a753-33cfb74a1a45 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:24.252253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 391/793] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:24.256221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112166-ad86-43e5-b10d-fd79aa6c0878 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.257745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3782f5-1571-461d-a753-33cfb74a1a45 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.302997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7905-be3f-449d-a425-04ba55ea9aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.303900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7905-be3f-449d-a425-04ba55ea9aff None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.304318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7905-be3f-449d-a425-04ba55ea9aff None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.304728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7905-be3f-449d-a425-04ba55ea9aff None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.305637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7905-be3f-449d-a425-04ba55ea9aff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:24.306090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7905-be3f-449d-a425-04ba55ea9aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:24.307719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb7905-be3f-449d-a425-04ba55ea9aff None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:24.324103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 403/794] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:24.340875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7905-be3f-449d-a425-04ba55ea9aff None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.347855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.353720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.385784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3782f5-1571-461d-a753-33cfb74a1a45 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.450958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7905-be3f-449d-a425-04ba55ea9aff None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.453655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a8f55-9c0d-43f0-8f26-d8aa0da5ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.454672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8f55-9c0d-43f0-8f26-d8aa0da5ff73 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.455202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8f55-9c0d-43f0-8f26-d8aa0da5ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.455676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8f55-9c0d-43f0-8f26-d8aa0da5ff73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.463941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a8f55-9c0d-43f0-8f26-d8aa0da5ff73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:24.465930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a8f55-9c0d-43f0-8f26-d8aa0da5ff73 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7b6a8f55-9c0d-43f0-8f26-d8aa0da5ff73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:24.479581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:24.480523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:24.481442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:24.481442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:24.481442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:24.481442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:24.481442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:24.481442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:24.481442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:24.481442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:24.488188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 392/795] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:24.488188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a58f6d-2235-4c27-98bb-119f43037e90 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.488188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a58f6d-2235-4c27-98bb-119f43037e90 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.488188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a58f6d-2235-4c27-98bb-119f43037e90 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.488188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 393/796] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:24.493639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a58f6d-2235-4c27-98bb-119f43037e90 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.495919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25508d-1133-4041-9fdd-31894daa9002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.496745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25508d-1133-4041-9fdd-31894daa9002 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.497046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25508d-1133-4041-9fdd-31894daa9002 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.497318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25508d-1133-4041-9fdd-31894daa9002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.509060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25508d-1133-4041-9fdd-31894daa9002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:24.510493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25508d-1133-4041-9fdd-31894daa9002 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-ea25508d-1133-4041-9fdd-31894daa9002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:24.525072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:24.525999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:24.526891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:24.526891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:24.526891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:24.526891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:24.526891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 404/797] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:24.527660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b2c01-e805-44f3-8522-56c7103f1073 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.527825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b2c01-e805-44f3-8522-56c7103f1073 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.528053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b2c01-e805-44f3-8522-56c7103f1073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.549115 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-059b2c01-e805-44f3-8522-56c7103f1073 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:24.550835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-059b2c01-e805-44f3-8522-56c7103f1073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:24.617675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a58f6d-2235-4c27-98bb-119f43037e90 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.618205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.636545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 405/798] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:24.638159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b2c01-e805-44f3-8522-56c7103f1073 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.655086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9793-346f-4f1d-acbe-155b6322784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.655713 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9793-346f-4f1d-acbe-155b6322784f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.669917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9793-346f-4f1d-acbe-155b6322784f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.669917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9793-346f-4f1d-acbe-155b6322784f None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.669917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9793-346f-4f1d-acbe-155b6322784f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:24.669917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9793-346f-4f1d-acbe-155b6322784f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:24.669917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9793-346f-4f1d-acbe-155b6322784f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:24.669917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.673349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 394/799] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:24.677133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9793-346f-4f1d-acbe-155b6322784f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.761283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b2c01-e805-44f3-8522-56c7103f1073 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.799822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433200b-9fcb-4150-95fb-22b4303fc4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.800443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433200b-9fcb-4150-95fb-22b4303fc4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.800718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433200b-9fcb-4150-95fb-22b4303fc4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.801013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433200b-9fcb-4150-95fb-22b4303fc4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.801705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433200b-9fcb-4150-95fb-22b4303fc4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:24.801990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433200b-9fcb-4150-95fb-22b4303fc4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:24.803653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433200b-9fcb-4150-95fb-22b4303fc4b6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:24.807715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9793-346f-4f1d-acbe-155b6322784f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.821497 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 406/800] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:24.822370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433200b-9fcb-4150-95fb-22b4303fc4b6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.852548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dadfb-b02f-47fa-bc10-52b4a79f692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:24.853506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dadfb-b02f-47fa-bc10-52b4a79f692a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:24.853783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dadfb-b02f-47fa-bc10-52b4a79f692a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:24.854056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dadfb-b02f-47fa-bc10-52b4a79f692a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:24.854699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dadfb-b02f-47fa-bc10-52b4a79f692a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:24.856071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dadfb-b02f-47fa-bc10-52b4a79f692a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-212dadfb-b02f-47fa-bc10-52b4a79f692a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:24.870805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:24.871759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:24.872602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 395/801] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:24.880678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dadfb-b02f-47fa-bc10-52b4a79f692a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:24.883457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.948697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:24.961551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433200b-9fcb-4150-95fb-22b4303fc4b6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:24.988819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dadfb-b02f-47fa-bc10-52b4a79f692a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.008614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02412e-4a45-4c69-b087-96e41dcaf4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.009650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02412e-4a45-4c69-b087-96e41dcaf4e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.010134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02412e-4a45-4c69-b087-96e41dcaf4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.011163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02412e-4a45-4c69-b087-96e41dcaf4e3 None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/38bd83f5a0bc4e7ea5cde1972c44503b/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.014364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02412e-4a45-4c69-b087-96e41dcaf4e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=38bd83f5a0bc4e7ea5cde1972c44503b, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.016756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02412e-4a45-4c69-b087-96e41dcaf4e3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.025357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73c7df-584d-4545-abe0-2df8355cebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.026002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73c7df-584d-4545-abe0-2df8355cebe6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.026286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73c7df-584d-4545-abe0-2df8355cebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.026561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73c7df-584d-4545-abe0-2df8355cebe6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.035164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73c7df-584d-4545-abe0-2df8355cebe6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.041547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73c7df-584d-4545-abe0-2df8355cebe6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2d73c7df-584d-4545-abe0-2df8355cebe6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:25.048225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:25.049203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:25.050152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:25.052862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 396/802] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 28 17:48:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:25.053899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73c7df-584d-4545-abe0-2df8355cebe6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.136659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 407/803] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:24 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/38bd83f5a0bc4e7ea5cde1972c44503b/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:25.138080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02412e-4a45-4c69-b087-96e41dcaf4e3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.170056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73c7df-584d-4545-abe0-2df8355cebe6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.201129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.217519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f87d2-7229-4567-84ca-8df44cd6af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.225049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f87d2-7229-4567-84ca-8df44cd6af62 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.225731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f87d2-7229-4567-84ca-8df44cd6af62 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.226171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f87d2-7229-4567-84ca-8df44cd6af62 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.227068 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f87d2-7229-4567-84ca-8df44cd6af62 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:25.227523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f87d2-7229-4567-84ca-8df44cd6af62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.229115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f87d2-7229-4567-84ca-8df44cd6af62 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.239996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 397/804] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:25.246314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f87d2-7229-4567-84ca-8df44cd6af62 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.356229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02412e-4a45-4c69-b087-96e41dcaf4e3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.366761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.407126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af7551-77cc-401c-81d1-2cd859b368d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.408165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7551-77cc-401c-81d1-2cd859b368d8 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.408611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7551-77cc-401c-81d1-2cd859b368d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.409094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7551-77cc-401c-81d1-2cd859b368d8 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.410102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7551-77cc-401c-81d1-2cd859b368d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:25.410559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7551-77cc-401c-81d1-2cd859b368d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.410918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f87d2-7229-4567-84ca-8df44cd6af62 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.412429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7551-77cc-401c-81d1-2cd859b368d8 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.437111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 408/805] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:25.438944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d103bc5-0e23-48ba-ad6d-45521e42939a None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.439378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d103bc5-0e23-48ba-ad6d-45521e42939a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.439864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d103bc5-0e23-48ba-ad6d-45521e42939a None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.443156 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 409/806] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:25.444150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d103bc5-0e23-48ba-ad6d-45521e42939a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.450756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0a6ed-9f11-457d-84fd-0dc3e75ba797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.451384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a6ed-9f11-457d-84fd-0dc3e75ba797 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.451663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a6ed-9f11-457d-84fd-0dc3e75ba797 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.451937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a6ed-9f11-457d-84fd-0dc3e75ba797 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.452624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a6ed-9f11-457d-84fd-0dc3e75ba797 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:25.452962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a6ed-9f11-457d-84fd-0dc3e75ba797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.454878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a6ed-9f11-457d-84fd-0dc3e75ba797 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.460583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 398/807] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:25.461741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c412-6537-4a5d-9f57-a1ec31a2e8b0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.462028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c412-6537-4a5d-9f57-a1ec31a2e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.462307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8c412-6537-4a5d-9f57-a1ec31a2e8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.480263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-aee8c412-6537-4a5d-9f57-a1ec31a2e8b0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:25.481494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aee8c412-6537-4a5d-9f57-a1ec31a2e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:25.530943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.560954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 399/808] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:25.562208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8c412-6537-4a5d-9f57-a1ec31a2e8b0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.565185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d103bc5-0e23-48ba-ad6d-45521e42939a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.604100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa226919-8499-4291-a09d-8bffb9587c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.604855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa226919-8499-4291-a09d-8bffb9587c18 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.605136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa226919-8499-4291-a09d-8bffb9587c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.605407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa226919-8499-4291-a09d-8bffb9587c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.637942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.676879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8c412-6537-4a5d-9f57-a1ec31a2e8b0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.678622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa226919-8499-4291-a09d-8bffb9587c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.680077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa226919-8499-4291-a09d-8bffb9587c18 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.717231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e17b1a-6b6e-4156-b137-905b2e853527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.717856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e17b1a-6b6e-4156-b137-905b2e853527 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.718197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e17b1a-6b6e-4156-b137-905b2e853527 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.718478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e17b1a-6b6e-4156-b137-905b2e853527 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.719195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e17b1a-6b6e-4156-b137-905b2e853527 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:25.720669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e17b1a-6b6e-4156-b137-905b2e853527 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:25.788771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 410/809] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:25.788771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9bde-19f1-4000-b033-a682167ece84 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.788771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9bde-19f1-4000-b033-a682167ece84 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.788771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9bde-19f1-4000-b033-a682167ece84 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.789521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 411/810] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:25.789759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f9bde-19f1-4000-b033-a682167ece84 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.854269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 400/811] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 17:48:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:25.855206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e17b1a-6b6e-4156-b137-905b2e853527 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:25.867387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.917210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:25.919466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f9bde-19f1-4000-b033-a682167ece84 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:25.972155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284570c5-227a-4d67-b43f-d5b47259168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:25.972875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284570c5-227a-4d67-b43f-d5b47259168e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.973226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284570c5-227a-4d67-b43f-d5b47259168e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.973622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284570c5-227a-4d67-b43f-d5b47259168e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:25.988465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284570c5-227a-4d67-b43f-d5b47259168e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-284570c5-227a-4d67-b43f-d5b47259168e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:25.993829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:25.994819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:25.996184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 412/812] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:25.998176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e0c4-d7bb-40cf-833b-e1ee49577970 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:25.998646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e0c4-d7bb-40cf-833b-e1ee49577970 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:25.998899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e0c4-d7bb-40cf-833b-e1ee49577970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.006118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e17b1a-6b6e-4156-b137-905b2e853527 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.021399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f9e5e0c4-d7bb-40cf-833b-e1ee49577970 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:26.022965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f9e5e0c4-d7bb-40cf-833b-e1ee49577970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:26.053536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b425d9-db22-49c7-a79b-9ae2150ce688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.054190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b425d9-db22-49c7-a79b-9ae2150ce688 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.054460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b425d9-db22-49c7-a79b-9ae2150ce688 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.055024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b425d9-db22-49c7-a79b-9ae2150ce688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.068732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b425d9-db22-49c7-a79b-9ae2150ce688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.070182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b425d9-db22-49c7-a79b-9ae2150ce688 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f5b425d9-db22-49c7-a79b-9ae2150ce688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:26.086434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:26.087571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:26.088477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:26.088477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:26.088477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:26.088477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:26.088477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 401/813] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:26.088762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b425d9-db22-49c7-a79b-9ae2150ce688 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.104818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 413/814] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:26.108027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e0c4-d7bb-40cf-833b-e1ee49577970 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.182420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:26.227710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:26.236659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e0c4-d7bb-40cf-833b-e1ee49577970 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.241115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b425d9-db22-49c7-a79b-9ae2150ce688 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.274068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bab72-572f-4523-b06e-c1eeb427a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.274595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bab72-572f-4523-b06e-c1eeb427a1af None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.274921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bab72-572f-4523-b06e-c1eeb427a1af None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.275140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bab72-572f-4523-b06e-c1eeb427a1af None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.275885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bab72-572f-4523-b06e-c1eeb427a1af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:26.276212 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bab72-572f-4523-b06e-c1eeb427a1af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.277616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bab72-572f-4523-b06e-c1eeb427a1af None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.284177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05032d-2beb-4138-afb5-5bff085ed5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.285635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05032d-2beb-4138-afb5-5bff085ed5fc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.286129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05032d-2beb-4138-afb5-5bff085ed5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.286607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05032d-2beb-4138-afb5-5bff085ed5fc None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.288247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05032d-2beb-4138-afb5-5bff085ed5fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:26.288806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05032d-2beb-4138-afb5-5bff085ed5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.290391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05032d-2beb-4138-afb5-5bff085ed5fc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.294889 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 414/815] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:26.295804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bab72-572f-4523-b06e-c1eeb427a1af None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.306643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 402/816] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:26.306643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05032d-2beb-4138-afb5-5bff085ed5fc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.427311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05032d-2beb-4138-afb5-5bff085ed5fc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.429626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bab72-572f-4523-b06e-c1eeb427a1af None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.441513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:26.464945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3b741-688e-4613-b5b6-24c39faa06fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.465608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3b741-688e-4613-b5b6-24c39faa06fd None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.465888 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3b741-688e-4613-b5b6-24c39faa06fd None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.466266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3b741-688e-4613-b5b6-24c39faa06fd None admin] PATH_INFO: `/v3/services/network` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.466895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3b741-688e-4613-b5b6-24c39faa06fd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.468260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3b741-688e-4613-b5b6-24c39faa06fd None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.473259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb031-11d6-4ad8-ab7b-dad86f1fa1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.474163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb031-11d6-4ad8-ab7b-dad86f1fa1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.474646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb031-11d6-4ad8-ab7b-dad86f1fa1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.475134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb031-11d6-4ad8-ab7b-dad86f1fa1e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-22e3b741-688e-4613-b5b6-24c39faa06fd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:26.477951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:26.478919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:26.479800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 415/817] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:26.480619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3b741-688e-4613-b5b6-24c39faa06fd None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.487352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeb031-11d6-4ad8-ab7b-dad86f1fa1e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.489118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeb031-11d6-4ad8-ab7b-dad86f1fa1e8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a8eeb031-11d6-4ad8-ab7b-dad86f1fa1e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:26.505889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:26.506808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:26.507724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:26.507724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:26.507724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:26.507724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:26.507724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:26.507724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:26.507724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:26.507724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:26.507724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 403/818] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:26.508210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb031-11d6-4ad8-ab7b-dad86f1fa1e8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.522472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:26.598135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3b741-688e-4613-b5b6-24c39faa06fd None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.615306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb031-11d6-4ad8-ab7b-dad86f1fa1e8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.636919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c88d-ec7f-4d39-91ea-1a9ada565f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.637562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c88d-ec7f-4d39-91ea-1a9ada565f3e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.637843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c88d-ec7f-4d39-91ea-1a9ada565f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.638118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c88d-ec7f-4d39-91ea-1a9ada565f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.650262 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8c88d-ec7f-4d39-91ea-1a9ada565f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.651795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8c88d-ec7f-4d39-91ea-1a9ada565f3e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.655568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15d8bc-41d7-4cfc-ab72-28f0eb850940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.656407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15d8bc-41d7-4cfc-ab72-28f0eb850940 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.656936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15d8bc-41d7-4cfc-ab72-28f0eb850940 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.658011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15d8bc-41d7-4cfc-ab72-28f0eb850940 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.659381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15d8bc-41d7-4cfc-ab72-28f0eb850940 None admin] RBAC: Adding query filter params (name=network) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:26.659900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15d8bc-41d7-4cfc-ab72-28f0eb850940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.662231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15d8bc-41d7-4cfc-ab72-28f0eb850940 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.667418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 404/819] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-03f8c88d-ec7f-4d39-91ea-1a9ada565f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:26.667552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:26.668353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:26.669367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:26.669367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:26.669367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:26.669367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:26.670858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15d8bc-41d7-4cfc-ab72-28f0eb850940 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.673675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 416/820] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:26.674692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c88d-ec7f-4d39-91ea-1a9ada565f3e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.705631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:26.773952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:26.802391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15d8bc-41d7-4cfc-ab72-28f0eb850940 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.803531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c88d-ec7f-4d39-91ea-1a9ada565f3e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.838210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655cacf-83a0-4bbe-8abf-3d414664f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.838969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655cacf-83a0-4bbe-8abf-3d414664f42b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.839352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655cacf-83a0-4bbe-8abf-3d414664f42b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.839725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655cacf-83a0-4bbe-8abf-3d414664f42b None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.840572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655cacf-83a0-4bbe-8abf-3d414664f42b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:26.841092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655cacf-83a0-4bbe-8abf-3d414664f42b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.842593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655cacf-83a0-4bbe-8abf-3d414664f42b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.849761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34a13f-db04-49b3-bef1-1c880276ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:26.850624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a13f-db04-49b3-bef1-1c880276ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:26.851089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a13f-db04-49b3-bef1-1c880276ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:26.852165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a13f-db04-49b3-bef1-1c880276ecd8 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:26.853035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34a13f-db04-49b3-bef1-1c880276ecd8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:26.854027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34a13f-db04-49b3-bef1-1c880276ecd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:26.855842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34a13f-db04-49b3-bef1-1c880276ecd8 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:26.857399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 405/821] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:26.858450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655cacf-83a0-4bbe-8abf-3d414664f42b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.862827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 417/822] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:26.864998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34a13f-db04-49b3-bef1-1c880276ecd8 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:26.969190 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:26.981081 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34a13f-db04-49b3-bef1-1c880276ecd8 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:26.998219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655cacf-83a0-4bbe-8abf-3d414664f42b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:27.018264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3b859-053a-42b8-a152-43b5151663c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:27.018890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3b859-053a-42b8-a152-43b5151663c5 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.019173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3b859-053a-42b8-a152-43b5151663c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.019448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3b859-053a-42b8-a152-43b5151663c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.020247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3b859-053a-42b8-a152-43b5151663c5 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=cb85b3e1dc464438ac007c1b09ea7fd3) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:27.020558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3b859-053a-42b8-a152-43b5151663c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:27.022199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3b859-053a-42b8-a152-43b5151663c5 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:27.029151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 418/823] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/role_assignments?user.id=cb85b3e1dc464438ac007c1b09ea7fd3&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:27.029946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3b859-053a-42b8-a152-43b5151663c5 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:27.044005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a159f-f2b6-470b-9d9e-894d12a142f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:27.045375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a159f-f2b6-470b-9d9e-894d12a142f5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.045853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a159f-f2b6-470b-9d9e-894d12a142f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.046474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a159f-f2b6-470b-9d9e-894d12a142f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.047788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a159f-f2b6-470b-9d9e-894d12a142f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:27.048447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a159f-f2b6-470b-9d9e-894d12a142f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:27.050297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a159f-f2b6-470b-9d9e-894d12a142f5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:27.053446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:27.067024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 406/824] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:27.080807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a159f-f2b6-470b-9d9e-894d12a142f5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:27.221157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3b859-053a-42b8-a152-43b5151663c5 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:27.253076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a159f-f2b6-470b-9d9e-894d12a142f5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:27.290445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac631c6f-ff45-4e9d-9c14-2ddea9fa9117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:27.291011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac631c6f-ff45-4e9d-9c14-2ddea9fa9117 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.291290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac631c6f-ff45-4e9d-9c14-2ddea9fa9117 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.291558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac631c6f-ff45-4e9d-9c14-2ddea9fa9117 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.301896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac631c6f-ff45-4e9d-9c14-2ddea9fa9117 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:27.303333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac631c6f-ff45-4e9d-9c14-2ddea9fa9117 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:27.303736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004913ec-bd37-49f7-a976-92ee35b6a34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:27.304453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004913ec-bd37-49f7-a976-92ee35b6a34a None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.304877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004913ec-bd37-49f7-a976-92ee35b6a34a None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.305230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004913ec-bd37-49f7-a976-92ee35b6a34a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.306010 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004913ec-bd37-49f7-a976-92ee35b6a34a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:27.307456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004913ec-bd37-49f7-a976-92ee35b6a34a None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ac631c6f-ff45-4e9d-9c14-2ddea9fa9117 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:27.317702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:27.318846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:27.320012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:27.322460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 407/825] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:48:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:27.328707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac631c6f-ff45-4e9d-9c14-2ddea9fa9117 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:27.386752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:27.429812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac631c6f-ff45-4e9d-9c14-2ddea9fa9117 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:27.449506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 419/826] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 17:48:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:27.456236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d387e-4840-4747-aab5-b7d5ef27488a None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.459034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d387e-4840-4747-aab5-b7d5ef27488a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.459339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d387e-4840-4747-aab5-b7d5ef27488a None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.463734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 420/827] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:27.468681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc47a7-f5ef-4432-bf0c-a0791691699b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.469346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc47a7-f5ef-4432-bf0c-a0791691699b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.469833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc47a7-f5ef-4432-bf0c-a0791691699b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.491175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9cbc47a7-f5ef-4432-bf0c-a0791691699b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:27.492973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9cbc47a7-f5ef-4432-bf0c-a0791691699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:27.496278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:27.502818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfe344-e97a-4d7f-98b2-fecaf8dd70c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:27.503513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfe344-e97a-4d7f-98b2-fecaf8dd70c3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.503798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfe344-e97a-4d7f-98b2-fecaf8dd70c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.504071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfe344-e97a-4d7f-98b2-fecaf8dd70c3 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.504961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfe344-e97a-4d7f-98b2-fecaf8dd70c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:27.505292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfe344-e97a-4d7f-98b2-fecaf8dd70c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:27.506853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfe344-e97a-4d7f-98b2-fecaf8dd70c3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:27.537298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 408/828] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 28 17:48:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:27.542706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfe344-e97a-4d7f-98b2-fecaf8dd70c3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:27.588209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 421/829] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:27.659482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc47a7-f5ef-4432-bf0c-a0791691699b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:27.718674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfe344-e97a-4d7f-98b2-fecaf8dd70c3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:27.732760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:27.768918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b320-3599-427f-987c-ecfba2048fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:27.769863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b320-3599-427f-987c-ecfba2048fdc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.770143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b320-3599-427f-987c-ecfba2048fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.770414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b320-3599-427f-987c-ecfba2048fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.788209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95b320-3599-427f-987c-ecfba2048fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:27.789807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95b320-3599-427f-987c-ecfba2048fdc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:27.792307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc47a7-f5ef-4432-bf0c-a0791691699b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4b95b320-3599-427f-987c-ecfba2048fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:27.809881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:27.810901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:27.812136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:27.812136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:27.812136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:27.812136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:27.812136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 409/830] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:27.817646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b320-3599-427f-987c-ecfba2048fdc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:27.834019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e3ea8-6b59-487b-acb4-436c594f3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:27.835408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e3ea8-6b59-487b-acb4-436c594f3618 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.836244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e3ea8-6b59-487b-acb4-436c594f3618 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.836682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e3ea8-6b59-487b-acb4-436c594f3618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.851478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:27.855752 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e3ea8-6b59-487b-acb4-436c594f3618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-e65e3ea8-6b59-487b-acb4-436c594f3618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:27.860874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:27.871152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 422/831] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:27.872122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e3ea8-6b59-487b-acb4-436c594f3618 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:27.939825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b320-3599-427f-987c-ecfba2048fdc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:27.976533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dba27b-b9bf-4da7-9275-51fc6dd9ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:27.976958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e3ea8-6b59-487b-acb4-436c594f3618 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:27.977781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dba27b-b9bf-4da7-9275-51fc6dd9ce97 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:27.978273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dba27b-b9bf-4da7-9275-51fc6dd9ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:27.978755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dba27b-b9bf-4da7-9275-51fc6dd9ce97 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:27.979744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dba27b-b9bf-4da7-9275-51fc6dd9ce97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:27.980257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dba27b-b9bf-4da7-9275-51fc6dd9ce97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:27.982959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dba27b-b9bf-4da7-9275-51fc6dd9ce97 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:27.996866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 410/832] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:28.001903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dba27b-b9bf-4da7-9275-51fc6dd9ce97 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.016761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0b19e-f976-4ce1-82ed-7af54b4a3983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.017412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0b19e-f976-4ce1-82ed-7af54b4a3983 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.017695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0b19e-f976-4ce1-82ed-7af54b4a3983 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.017968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0b19e-f976-4ce1-82ed-7af54b4a3983 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.018767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0b19e-f976-4ce1-82ed-7af54b4a3983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:28.018983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0b19e-f976-4ce1-82ed-7af54b4a3983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.020370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0b19e-f976-4ce1-82ed-7af54b4a3983 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.032577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 423/833] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:28.034735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.038154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0b19e-f976-4ce1-82ed-7af54b4a3983 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.107263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.127255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dba27b-b9bf-4da7-9275-51fc6dd9ce97 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.144588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0b19e-f976-4ce1-82ed-7af54b4a3983 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.172075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9bdcb-66da-45eb-966a-f28ce945f10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.173472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9bdcb-66da-45eb-966a-f28ce945f10d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.173758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9bdcb-66da-45eb-966a-f28ce945f10d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.174031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9bdcb-66da-45eb-966a-f28ce945f10d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.181419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9bdcb-66da-45eb-966a-f28ce945f10d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.182873 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9bdcb-66da-45eb-966a-f28ce945f10d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.187274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2875a-b74c-4a7b-a9cb-40ca9e2eb9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.188148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2875a-b74c-4a7b-a9cb-40ca9e2eb9dc None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.188940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2875a-b74c-4a7b-a9cb-40ca9e2eb9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.189416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2875a-b74c-4a7b-a9cb-40ca9e2eb9dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c9b9bdcb-66da-45eb-966a-f28ce945f10d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:28.194342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:28.195256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 411/834] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93a3f5-fdaf-442a-a065-31f8b589edf9 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93a3f5-fdaf-442a-a065-31f8b589edf9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.201812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93a3f5-fdaf-442a-a065-31f8b589edf9 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.201812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 412/835] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:28.201812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93a3f5-fdaf-442a-a065-31f8b589edf9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.205608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2875a-b74c-4a7b-a9cb-40ca9e2eb9dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.207089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2875a-b74c-4a7b-a9cb-40ca9e2eb9dc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-c9a2875a-b74c-4a7b-a9cb-40ca9e2eb9dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:28.222113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:28.223028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:28.223923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:28.223923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:28.223923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:28.223923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:28.227903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 424/836] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:28.229234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a402097-0550-4841-9b06-d1674d893f49 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.229420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a402097-0550-4841-9b06-d1674d893f49 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.229695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a402097-0550-4841-9b06-d1674d893f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.247586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8a402097-0550-4841-9b06-d1674d893f49 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:28.248754 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8a402097-0550-4841-9b06-d1674d893f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:28.290566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.310172 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93a3f5-fdaf-442a-a065-31f8b589edf9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.323017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 425/837] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:28.323977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a402097-0550-4841-9b06-d1674d893f49 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.357458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b7392-b940-4c23-a4a3-c20d9a85c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.358549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b7392-b940-4c23-a4a3-c20d9a85c1cb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.358827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b7392-b940-4c23-a4a3-c20d9a85c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.359093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b7392-b940-4c23-a4a3-c20d9a85c1cb None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.359838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b7392-b940-4c23-a4a3-c20d9a85c1cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:28.360653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b7392-b940-4c23-a4a3-c20d9a85c1cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.362098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b7392-b940-4c23-a4a3-c20d9a85c1cb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.370226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.374621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 413/838] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:28.382331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b7392-b940-4c23-a4a3-c20d9a85c1cb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.433331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a402097-0550-4841-9b06-d1674d893f49 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.470631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44bf22-476b-4e68-82f7-d0797ca46371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.471483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44bf22-476b-4e68-82f7-d0797ca46371 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.471767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44bf22-476b-4e68-82f7-d0797ca46371 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.472042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44bf22-476b-4e68-82f7-d0797ca46371 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.472734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44bf22-476b-4e68-82f7-d0797ca46371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:28.473109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44bf22-476b-4e68-82f7-d0797ca46371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.474489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44bf22-476b-4e68-82f7-d0797ca46371 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.490123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 426/839] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:28.490123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44bf22-476b-4e68-82f7-d0797ca46371 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.493995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b7392-b940-4c23-a4a3-c20d9a85c1cb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.529879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c303c2e-1098-4136-8572-62a1153e4ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.530802 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c303c2e-1098-4136-8572-62a1153e4ede None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.530986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c303c2e-1098-4136-8572-62a1153e4ede None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.531371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c303c2e-1098-4136-8572-62a1153e4ede None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.532121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c303c2e-1098-4136-8572-62a1153e4ede None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.533645 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c303c2e-1098-4136-8572-62a1153e4ede None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9c303c2e-1098-4136-8572-62a1153e4ede None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:28.549392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:28.550640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:28.551729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 414/840] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:28.552757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c303c2e-1098-4136-8572-62a1153e4ede None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.559982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.607305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44bf22-476b-4e68-82f7-d0797ca46371 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.609700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.642424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa419d-9033-4113-b24e-7314b1cef4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.643087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa419d-9033-4113-b24e-7314b1cef4ee None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.643367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa419d-9033-4113-b24e-7314b1cef4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.643645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa419d-9033-4113-b24e-7314b1cef4ee None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/36f4189de0674590a257d9de7a60c63f/roles/467b18ae24a4482592d2b45bc717c5eb` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.652028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c303c2e-1098-4136-8572-62a1153e4ede None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.657763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa419d-9033-4113-b24e-7314b1cef4ee None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=36f4189de0674590a257d9de7a60c63f, role_id=467b18ae24a4482592d2b45bc717c5eb)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.659292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa419d-9033-4113-b24e-7314b1cef4ee None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.685686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df26d28-6e34-4b14-95b9-d3ab1b6143f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.686611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26d28-6e34-4b14-95b9-d3ab1b6143f1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.686885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26d28-6e34-4b14-95b9-d3ab1b6143f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.687153 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26d28-6e34-4b14-95b9-d3ab1b6143f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.695132 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df26d28-6e34-4b14-95b9-d3ab1b6143f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.696552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df26d28-6e34-4b14-95b9-d3ab1b6143f1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9df26d28-6e34-4b14-95b9-d3ab1b6143f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:28.707859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:28.709933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 415/841] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:28.711205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df26d28-6e34-4b14-95b9-d3ab1b6143f1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.764820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 427/842] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:28 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/36f4189de0674590a257d9de7a60c63f/roles/467b18ae24a4482592d2b45bc717c5eb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:28.764820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa419d-9033-4113-b24e-7314b1cef4ee None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.789953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:28.830901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df26d28-6e34-4b14-95b9-d3ab1b6143f1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.882763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb53065-4aa0-49be-8b8c-f335e4540210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.883425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb53065-4aa0-49be-8b8c-f335e4540210 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.883770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb53065-4aa0-49be-8b8c-f335e4540210 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.883889 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa419d-9033-4113-b24e-7314b1cef4ee None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:28.884318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb53065-4aa0-49be-8b8c-f335e4540210 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.885012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb53065-4aa0-49be-8b8c-f335e4540210 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:28.885384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb53065-4aa0-49be-8b8c-f335e4540210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.888292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb53065-4aa0-49be-8b8c-f335e4540210 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.894758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 416/843] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:28.900849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb53065-4aa0-49be-8b8c-f335e4540210 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.928290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa09fef-584b-4a47-a3b8-84214a2477b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:28.929358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa09fef-584b-4a47-a3b8-84214a2477b6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:28.929712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa09fef-584b-4a47-a3b8-84214a2477b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:28.930050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa09fef-584b-4a47-a3b8-84214a2477b6 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:28.931139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa09fef-584b-4a47-a3b8-84214a2477b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:28.931514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa09fef-584b-4a47-a3b8-84214a2477b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:28.933813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa09fef-584b-4a47-a3b8-84214a2477b6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:28.961067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 428/844] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:28.966719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa09fef-584b-4a47-a3b8-84214a2477b6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:28.982538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.032952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb53065-4aa0-49be-8b8c-f335e4540210 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.063759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.070637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70fca4-2c73-4d30-9441-36cb70f69b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.071273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70fca4-2c73-4d30-9441-36cb70f69b98 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.077681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70fca4-2c73-4d30-9441-36cb70f69b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.077681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70fca4-2c73-4d30-9441-36cb70f69b98 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.077681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70fca4-2c73-4d30-9441-36cb70f69b98 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:29.077681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70fca4-2c73-4d30-9441-36cb70f69b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.077681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70fca4-2c73-4d30-9441-36cb70f69b98 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.079367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 417/845] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:29.109144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa09fef-584b-4a47-a3b8-84214a2477b6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.148599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2181ea-9bfc-4d1f-bee8-77053f67f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.149193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2181ea-9bfc-4d1f-bee8-77053f67f87c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.149522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2181ea-9bfc-4d1f-bee8-77053f67f87c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.149800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2181ea-9bfc-4d1f-bee8-77053f67f87c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.232370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2181ea-9bfc-4d1f-bee8-77053f67f87c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.233885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2181ea-9bfc-4d1f-bee8-77053f67f87c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.249687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.333580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d8d77-581d-471d-a9ea-9e570a3e0cd8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.333901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d8d77-581d-471d-a9ea-9e570a3e0cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.334131 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d8d77-581d-471d-a9ea-9e570a3e0cd8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.336345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 418/846] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:29.341207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7802b-8a86-4c50-87ff-0b0ae82c3e32 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.341492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7802b-8a86-4c50-87ff-0b0ae82c3e32 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.341770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7802b-8a86-4c50-87ff-0b0ae82c3e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.358284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 429/847] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:29.360101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fef7802b-8a86-4c50-87ff-0b0ae82c3e32 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:29.361333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fef7802b-8a86-4c50-87ff-0b0ae82c3e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:29.363333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2181ea-9bfc-4d1f-bee8-77053f67f87c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.438638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 419/848] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:29.455618 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7802b-8a86-4c50-87ff-0b0ae82c3e32 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.490132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2181ea-9bfc-4d1f-bee8-77053f67f87c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.507931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.536460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f84cb9-01f9-4ca1-a06f-790abbb04ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.537127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84cb9-01f9-4ca1-a06f-790abbb04ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.537411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84cb9-01f9-4ca1-a06f-790abbb04ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.537838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84cb9-01f9-4ca1-a06f-790abbb04ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.551182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f84cb9-01f9-4ca1-a06f-790abbb04ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.552923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f84cb9-01f9-4ca1-a06f-790abbb04ed9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.556592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7802b-8a86-4c50-87ff-0b0ae82c3e32 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-46f84cb9-01f9-4ca1-a06f-790abbb04ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:29.577167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:29.579016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:29.580839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:29.580839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:29.580839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:29.580839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:29.580839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 430/849] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:29.585261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f84cb9-01f9-4ca1-a06f-790abbb04ed9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.588913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.607373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bffb1-c396-4e94-ae4f-e02e55dc41c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.608440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bffb1-c396-4e94-ae4f-e02e55dc41c1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.608752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bffb1-c396-4e94-ae4f-e02e55dc41c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.609066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bffb1-c396-4e94-ae4f-e02e55dc41c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.610208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bffb1-c396-4e94-ae4f-e02e55dc41c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.612589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bffb1-c396-4e94-ae4f-e02e55dc41c1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2d0bffb1-c396-4e94-ae4f-e02e55dc41c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:29.626388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:29.627733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:48:29.629314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:29.636823 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 420/850] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:29.636823 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bffb1-c396-4e94-ae4f-e02e55dc41c1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.709120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f84cb9-01f9-4ca1-a06f-790abbb04ed9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.754993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfbd38-d5f6-4681-86e5-e9ec811a3214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.755616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfbd38-d5f6-4681-86e5-e9ec811a3214 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.755897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfbd38-d5f6-4681-86e5-e9ec811a3214 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.756173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfbd38-d5f6-4681-86e5-e9ec811a3214 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.756904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfbd38-d5f6-4681-86e5-e9ec811a3214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:29.757362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfbd38-d5f6-4681-86e5-e9ec811a3214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.759374 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfbd38-d5f6-4681-86e5-e9ec811a3214 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.762127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bffb1-c396-4e94-ae4f-e02e55dc41c1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.774879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 431/851] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:29.780487 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfbd38-d5f6-4681-86e5-e9ec811a3214 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.804178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932a1f7-b55a-4d82-8179-759bcc17637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.805538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932a1f7-b55a-4d82-8179-759bcc17637f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.806042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932a1f7-b55a-4d82-8179-759bcc17637f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.806518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932a1f7-b55a-4d82-8179-759bcc17637f None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.807534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932a1f7-b55a-4d82-8179-759bcc17637f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:29.808049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932a1f7-b55a-4d82-8179-759bcc17637f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.811486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.811773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932a1f7-b55a-4d82-8179-759bcc17637f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.817530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 421/852] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:29.823395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932a1f7-b55a-4d82-8179-759bcc17637f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.883089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:29.907422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfbd38-d5f6-4681-86e5-e9ec811a3214 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.937644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932a1f7-b55a-4d82-8179-759bcc17637f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:29.947146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2f20a-db73-40f6-a43b-cc35105fe3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.948084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2f20a-db73-40f6-a43b-cc35105fe3be None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.948690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2f20a-db73-40f6-a43b-cc35105fe3be None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.949198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2f20a-db73-40f6-a43b-cc35105fe3be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.956988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2f20a-db73-40f6-a43b-cc35105fe3be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.958750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2f20a-db73-40f6-a43b-cc35105fe3be None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-bfe2f20a-db73-40f6-a43b-cc35105fe3be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:29.971868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:29.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:29.973774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:29.973774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:29.973774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:29.973774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:29.973774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:29.973774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:29.973774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:29.973774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:29.974193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da8cf-9d61-4898-901a-7716f70f122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:29.974798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da8cf-9d61-4898-901a-7716f70f122e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:29.974798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da8cf-9d61-4898-901a-7716f70f122e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:29.975034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da8cf-9d61-4898-901a-7716f70f122e None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:29.975701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045da8cf-9d61-4898-901a-7716f70f122e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:29.976007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045da8cf-9d61-4898-901a-7716f70f122e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:29.981647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045da8cf-9d61-4898-901a-7716f70f122e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:29.981922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 432/853] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:29.983132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2f20a-db73-40f6-a43b-cc35105fe3be None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:29.989816 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 422/854] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:30.085261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:30.102796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2f20a-db73-40f6-a43b-cc35105fe3be None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:30.140999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f679a-b0ea-4fb0-a6cb-c8654581e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:30.142342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f679a-b0ea-4fb0-a6cb-c8654581e683 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:30.142739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f679a-b0ea-4fb0-a6cb-c8654581e683 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:30.143150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f679a-b0ea-4fb0-a6cb-c8654581e683 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:30.144348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f679a-b0ea-4fb0-a6cb-c8654581e683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:30.145050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f679a-b0ea-4fb0-a6cb-c8654581e683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:30.147899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f679a-b0ea-4fb0-a6cb-c8654581e683 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:30.162294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 433/855] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:30.168402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da8cf-9d61-4898-901a-7716f70f122e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:30.284845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da8cf-9d61-4898-901a-7716f70f122e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:30.301923 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:30.321609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f507b42-1726-48f9-826b-986b2bd51062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:30.322355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f507b42-1726-48f9-826b-986b2bd51062 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:30.322705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f507b42-1726-48f9-826b-986b2bd51062 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:30.323044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f507b42-1726-48f9-826b-986b2bd51062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:30.323906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f507b42-1726-48f9-826b-986b2bd51062 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=38bd83f5a0bc4e7ea5cde1972c44503b) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:30.324284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f507b42-1726-48f9-826b-986b2bd51062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:30.325801 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f507b42-1726-48f9-826b-986b2bd51062 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:30.333234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 423/856] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:30 2022] GET /identity/v3/role_assignments?user.id=38bd83f5a0bc4e7ea5cde1972c44503b&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:30.912294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2104-894f-433a-85dc-dca421598d20 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:30.913031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2104-894f-433a-85dc-dca421598d20 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:30.913031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2104-894f-433a-85dc-dca421598d20 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:30.914527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 434/857] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:30.919967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad00c-c4f1-41d8-90f5-719e0f5bd500 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:30.920454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad00c-c4f1-41d8-90f5-719e0f5bd500 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:30.920624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad00c-c4f1-41d8-90f5-719e0f5bd500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:30.940671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-798ad00c-c4f1-41d8-90f5-719e0f5bd500 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:30.941890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-798ad00c-c4f1-41d8-90f5-719e0f5bd500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:31.011950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 424/858] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:31.035274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2104-894f-433a-85dc-dca421598d20 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:31.144129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2104-894f-433a-85dc-dca421598d20 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:31.166078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f593c8c-1311-4342-9a22-0e9f6ae73b48 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:31.166365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f593c8c-1311-4342-9a22-0e9f6ae73b48 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:31.166519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f593c8c-1311-4342-9a22-0e9f6ae73b48 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:31.175467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 425/859] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:31.176853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4139ca9-1208-47d1-859d-aa3a4047b25a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:31.177163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4139ca9-1208-47d1-859d-aa3a4047b25a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:31.177416 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4139ca9-1208-47d1-859d-aa3a4047b25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:31.197156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b4139ca9-1208-47d1-859d-aa3a4047b25a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:31.197590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819572-76b1-4d05-b6f7-f9383598074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:31.198344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b4139ca9-1208-47d1-859d-aa3a4047b25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:31.198709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819572-76b1-4d05-b6f7-f9383598074d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:31.199212 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819572-76b1-4d05-b6f7-f9383598074d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:31.199733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819572-76b1-4d05-b6f7-f9383598074d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:31.214832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f819572-76b1-4d05-b6f7-f9383598074d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-5f819572-76b1-4d05-b6f7-f9383598074d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:31.222588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:31.223548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:48:31.224399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:31.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 435/860] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:48:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:31.232465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819572-76b1-4d05-b6f7-f9383598074d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:31.253123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:31.281887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 426/861] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:31.307349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4139ca9-1208-47d1-859d-aa3a4047b25a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:31.355026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819572-76b1-4d05-b6f7-f9383598074d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:31.358978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:31.399305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026599f5-4b94-4ff1-9e7c-ba42215c3708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:31.399928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026599f5-4b94-4ff1-9e7c-ba42215c3708 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:31.400206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026599f5-4b94-4ff1-9e7c-ba42215c3708 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:31.400477 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026599f5-4b94-4ff1-9e7c-ba42215c3708 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:31.403315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026599f5-4b94-4ff1-9e7c-ba42215c3708 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:31.403692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026599f5-4b94-4ff1-9e7c-ba42215c3708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:31.405104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026599f5-4b94-4ff1-9e7c-ba42215c3708 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:31.421826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 436/862] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:48:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:31.422835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026599f5-4b94-4ff1-9e7c-ba42215c3708 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:31.440383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4139ca9-1208-47d1-859d-aa3a4047b25a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:31.492152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c7bd-bb1c-4a91-94b0-426961fd4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:31.492843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c7bd-bb1c-4a91-94b0-426961fd4ab7 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:31.493133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c7bd-bb1c-4a91-94b0-426961fd4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:31.493406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c7bd-bb1c-4a91-94b0-426961fd4ab7 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:31.494291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528c7bd-bb1c-4a91-94b0-426961fd4ab7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:31.495657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528c7bd-bb1c-4a91-94b0-426961fd4ab7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:31.516980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:31.551731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026599f5-4b94-4ff1-9e7c-ba42215c3708 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:31.586703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 427/863] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:48:31 2022] POST /identity/v3/services => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:31.601622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e0d71-939d-4167-ab4a-a6a0019536e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:31.602307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e0d71-939d-4167-ab4a-a6a0019536e7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:31.602643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e0d71-939d-4167-ab4a-a6a0019536e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:31.602926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e0d71-939d-4167-ab4a-a6a0019536e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:31.617220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e0d71-939d-4167-ab4a-a6a0019536e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:31.618714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e0d71-939d-4167-ab4a-a6a0019536e7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-437e0d71-939d-4167-ab4a-a6a0019536e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:31.636847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:31.637812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:31.638787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:31.638787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:31.638787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:31.638787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:31.638787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 437/864] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:31.644827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c7bd-bb1c-4a91-94b0-426961fd4ab7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:31.761848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:31.768701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c7bd-bb1c-4a91-94b0-426961fd4ab7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:31.808763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5c40f-b990-4a5e-bdaa-226193737c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:31.809774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5c40f-b990-4a5e-bdaa-226193737c3b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:31.810259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5c40f-b990-4a5e-bdaa-226193737c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:31.810749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5c40f-b990-4a5e-bdaa-226193737c3b None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:31.811913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5c40f-b990-4a5e-bdaa-226193737c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:31.812428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5c40f-b990-4a5e-bdaa-226193737c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:31.814059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5c40f-b990-4a5e-bdaa-226193737c3b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:31.827106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 428/865] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:31.833061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e0d71-939d-4167-ab4a-a6a0019536e7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:31.943641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e0d71-939d-4167-ab4a-a6a0019536e7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:31.959274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:31.981837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e254e-fd28-4d07-82b6-d1bdadef2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:31.982825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e254e-fd28-4d07-82b6-d1bdadef2e37 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:31.983355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e254e-fd28-4d07-82b6-d1bdadef2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:31.983864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e254e-fd28-4d07-82b6-d1bdadef2e37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:31.993075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e254e-fd28-4d07-82b6-d1bdadef2e37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:31.994948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e254e-fd28-4d07-82b6-d1bdadef2e37 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-af1e254e-fd28-4d07-82b6-d1bdadef2e37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:32.007255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:32.008249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:32.009259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:32.012061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 438/866] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:48:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:32.018188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5c40f-b990-4a5e-bdaa-226193737c3b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:32.071605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20bc09-0bc8-4d6b-8b3f-6c912803246a None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.071916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20bc09-0bc8-4d6b-8b3f-6c912803246a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.072153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20bc09-0bc8-4d6b-8b3f-6c912803246a None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.073773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 439/867] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:32.078847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465839d-e40a-44d0-999a-a1835c47a719 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.079117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465839d-e40a-44d0-999a-a1835c47a719 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.079393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465839d-e40a-44d0-999a-a1835c47a719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.100498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c465839d-e40a-44d0-999a-a1835c47a719 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:32.102435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c465839d-e40a-44d0-999a-a1835c47a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:32.150027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5c40f-b990-4a5e-bdaa-226193737c3b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:32.190229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 440/868] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:32.208721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82fe22-845f-411a-979a-7858e843f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:32.209461 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82fe22-845f-411a-979a-7858e843f190 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.209811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82fe22-845f-411a-979a-7858e843f190 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.210149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82fe22-845f-411a-979a-7858e843f190 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.211014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82fe22-845f-411a-979a-7858e843f190 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:32.211383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82fe22-845f-411a-979a-7858e843f190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:32.212894 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82fe22-845f-411a-979a-7858e843f190 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:32.213049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465839d-e40a-44d0-999a-a1835c47a719 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:32.234019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 429/869] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:32.239203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82fe22-845f-411a-979a-7858e843f190 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:32.259396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:32.337466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465839d-e40a-44d0-999a-a1835c47a719 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:32.340016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:32.352106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82fe22-845f-411a-979a-7858e843f190 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:32.381778 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037cd48-be58-4fc7-b647-49a69df650b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:32.382412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037cd48-be58-4fc7-b647-49a69df650b6 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.382696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037cd48-be58-4fc7-b647-49a69df650b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.383306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037cd48-be58-4fc7-b647-49a69df650b6 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.384290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037cd48-be58-4fc7-b647-49a69df650b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:32.385941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037cd48-be58-4fc7-b647-49a69df650b6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:32.393327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ba8da-30bd-4d50-b4ab-dee0d4455f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:32.393986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba8da-30bd-4d50-b4ab-dee0d4455f38 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.394264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba8da-30bd-4d50-b4ab-dee0d4455f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.394537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba8da-30bd-4d50-b4ab-dee0d4455f38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.465758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ba8da-30bd-4d50-b4ab-dee0d4455f38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:32.467190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ba8da-30bd-4d50-b4ab-dee0d4455f38 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:32.485026 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:32.551100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 441/870] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:48:32 2022] POST /identity/v3/services => generated 269 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:32.560609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275654d-0c5f-421d-b4fa-d6430baab05e None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.560911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275654d-0c5f-421d-b4fa-d6430baab05e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.561187 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275654d-0c5f-421d-b4fa-d6430baab05e None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.562955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 442/871] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:32.569453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 430/872] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:32.570725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275654d-0c5f-421d-b4fa-d6430baab05e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:32.574542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035059-4005-4a94-a247-696538173f99 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.574831 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035059-4005-4a94-a247-696538173f99 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.575113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035059-4005-4a94-a247-696538173f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.595704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-05035059-4005-4a94-a247-696538173f99 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:32.596891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-05035059-4005-4a94-a247-696538173f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:32.684350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 431/873] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:32.702894 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035059-4005-4a94-a247-696538173f99 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:32.720434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275654d-0c5f-421d-b4fa-d6430baab05e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:32.760775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:32.771581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afd593-59fe-499b-a9f9-38966017faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:32.772276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afd593-59fe-499b-a9f9-38966017faac None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.772554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afd593-59fe-499b-a9f9-38966017faac None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.772855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afd593-59fe-499b-a9f9-38966017faac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.786074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afd593-59fe-499b-a9f9-38966017faac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:32.787547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afd593-59fe-499b-a9f9-38966017faac None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-43afd593-59fe-499b-a9f9-38966017faac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:32.805572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:32.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:32.807486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:32.807486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:32.807486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:32.807486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:32.811779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 443/874] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:32.813759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afd593-59fe-499b-a9f9-38966017faac None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:32.836466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:32.845249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035059-4005-4a94-a247-696538173f99 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:32.884424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5aa4d-5634-4c34-8532-c4ded4dfbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:32.885399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5aa4d-5634-4c34-8532-c4ded4dfbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.885859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5aa4d-5634-4c34-8532-c4ded4dfbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.886548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5aa4d-5634-4c34-8532-c4ded4dfbfc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.887425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5aa4d-5634-4c34-8532-c4ded4dfbfc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:32.888995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5aa4d-5634-4c34-8532-c4ded4dfbfc6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5af5aa4d-5634-4c34-8532-c4ded4dfbfc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:32.899846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:32.900922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:32.901807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:32.904335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 432/875] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:32.913187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5aa4d-5634-4c34-8532-c4ded4dfbfc6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:32.925297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afd593-59fe-499b-a9f9-38966017faac None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:32.963976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e5980-c153-4a9f-997e-e1d1857a26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:32.964730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e5980-c153-4a9f-997e-e1d1857a26ca None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:32.964921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e5980-c153-4a9f-997e-e1d1857a26ca None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:32.965183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e5980-c153-4a9f-997e-e1d1857a26ca None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:32.965874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e5980-c153-4a9f-997e-e1d1857a26ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:32.966176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e5980-c153-4a9f-997e-e1d1857a26ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:32.967647 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e5980-c153-4a9f-997e-e1d1857a26ca None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:32.984942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 444/876] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:32.986914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e5980-c153-4a9f-997e-e1d1857a26ca None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.023731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5aa4d-5634-4c34-8532-c4ded4dfbfc6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.033953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:33.062762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65ed76-3762-41d3-b83f-ddeccb909796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.063141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ed76-3762-41d3-b83f-ddeccb909796 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.064033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ed76-3762-41d3-b83f-ddeccb909796 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.064316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ed76-3762-41d3-b83f-ddeccb909796 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.065141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65ed76-3762-41d3-b83f-ddeccb909796 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:33.065454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65ed76-3762-41d3-b83f-ddeccb909796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.066979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65ed76-3762-41d3-b83f-ddeccb909796 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.077011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 433/877] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:33.080294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65ed76-3762-41d3-b83f-ddeccb909796 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.080821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:33.113818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e5980-c153-4a9f-997e-e1d1857a26ca None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.167712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53dc6a-d260-4ba6-8c82-916c51378a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.168726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53dc6a-d260-4ba6-8c82-916c51378a43 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.169237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53dc6a-d260-4ba6-8c82-916c51378a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.170139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53dc6a-d260-4ba6-8c82-916c51378a43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.179927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53dc6a-d260-4ba6-8c82-916c51378a43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.182361 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53dc6a-d260-4ba6-8c82-916c51378a43 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-df53dc6a-d260-4ba6-8c82-916c51378a43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:33.199911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:33.200975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:33.201862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:33.201862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:33.201862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:33.201862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:33.201862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:33.201862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:33.201862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:33.201862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:33.204130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65ed76-3762-41d3-b83f-ddeccb909796 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.206379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 445/878] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:33.208605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53dc6a-d260-4ba6-8c82-916c51378a43 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.252350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ad1d2-a349-45c1-9bf4-70529a5a4474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.253042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ad1d2-a349-45c1-9bf4-70529a5a4474 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.253324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ad1d2-a349-45c1-9bf4-70529a5a4474 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.253598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ad1d2-a349-45c1-9bf4-70529a5a4474 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.254390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ad1d2-a349-45c1-9bf4-70529a5a4474 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:33.254699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ad1d2-a349-45c1-9bf4-70529a5a4474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.256140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ad1d2-a349-45c1-9bf4-70529a5a4474 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.267418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 434/879] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:33.319973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53dc6a-d260-4ba6-8c82-916c51378a43 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.358662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d7b94-c339-412e-865d-57154a63c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.359695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d7b94-c339-412e-865d-57154a63c649 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.360309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d7b94-c339-412e-865d-57154a63c649 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.360831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d7b94-c339-412e-865d-57154a63c649 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.361840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d7b94-c339-412e-865d-57154a63c649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:33.362366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d7b94-c339-412e-865d-57154a63c649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.364075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d7b94-c339-412e-865d-57154a63c649 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.368093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:33.380359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 446/880] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:33.386546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ad1d2-a349-45c1-9bf4-70529a5a4474 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.430881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:33.500287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ad1d2-a349-45c1-9bf4-70529a5a4474 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:33.536041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d0d11-2d9c-4516-98b7-3295940c8154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:33.537022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0d11-2d9c-4516-98b7-3295940c8154 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.537473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0d11-2d9c-4516-98b7-3295940c8154 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.537912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0d11-2d9c-4516-98b7-3295940c8154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.544644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d0d11-2d9c-4516-98b7-3295940c8154 None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=36f4189de0674590a257d9de7a60c63f) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:33.544644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d0d11-2d9c-4516-98b7-3295940c8154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:33.544644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d0d11-2d9c-4516-98b7-3295940c8154 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:33.547716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 435/881] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:33 2022] GET /identity/v3/role_assignments?user.id=36f4189de0674590a257d9de7a60c63f&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:33.728633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82fa84-fb0b-4ff9-8fce-afb5aaded0f3 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.728912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82fa84-fb0b-4ff9-8fce-afb5aaded0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.729345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82fa84-fb0b-4ff9-8fce-afb5aaded0f3 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.731006 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 447/882] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:33.736791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba2f42-1991-44d1-a1ce-219d77aadf9f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:33.737181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba2f42-1991-44d1-a1ce-219d77aadf9f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:33.737522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba2f42-1991-44d1-a1ce-219d77aadf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:33.758067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-efba2f42-1991-44d1-a1ce-219d77aadf9f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:33.759299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-efba2f42-1991-44d1-a1ce-219d77aadf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:33.837113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 436/883] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:33.859247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82fa84-fb0b-4ff9-8fce-afb5aaded0f3 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:33.964502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82fa84-fb0b-4ff9-8fce-afb5aaded0f3 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.003052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100265-0af3-4f73-928e-647d2076441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.003664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100265-0af3-4f73-928e-647d2076441f None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.003946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100265-0af3-4f73-928e-647d2076441f None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.004220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100265-0af3-4f73-928e-647d2076441f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.004870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12100265-0af3-4f73-928e-647d2076441f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.006243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12100265-0af3-4f73-928e-647d2076441f None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-12100265-0af3-4f73-928e-647d2076441f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:34.015838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:34.016996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:34.017951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 448/884] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:48:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:34.024970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba2f42-1991-44d1-a1ce-219d77aadf9f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:34.057233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:34.128161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba2f42-1991-44d1-a1ce-219d77aadf9f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.174462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e81e6-5b84-44a3-9009-6500ab21ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.175401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e81e6-5b84-44a3-9009-6500ab21ee7f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.175876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e81e6-5b84-44a3-9009-6500ab21ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.176341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e81e6-5b84-44a3-9009-6500ab21ee7f None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.177245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e81e6-5b84-44a3-9009-6500ab21ee7f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:34.177742 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e81e6-5b84-44a3-9009-6500ab21ee7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.179302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e81e6-5b84-44a3-9009-6500ab21ee7f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.185081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 437/885] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:48:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:34.191587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100265-0af3-4f73-928e-647d2076441f None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:34.256535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:34.303287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100265-0af3-4f73-928e-647d2076441f None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.352807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c27b76-cbd5-4985-be36-31fc35d1b857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.352807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27b76-cbd5-4985-be36-31fc35d1b857 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.352807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27b76-cbd5-4985-be36-31fc35d1b857 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.352807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27b76-cbd5-4985-be36-31fc35d1b857 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.353241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27b76-cbd5-4985-be36-31fc35d1b857 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:34.353241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27b76-cbd5-4985-be36-31fc35d1b857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.353241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27b76-cbd5-4985-be36-31fc35d1b857 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.364838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 449/886] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:48:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:34.366197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e81e6-5b84-44a3-9009-6500ab21ee7f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:34.563665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:34.573317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e81e6-5b84-44a3-9009-6500ab21ee7f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.639655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13245f-7709-444e-acbf-b1d0cca6013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.640287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13245f-7709-444e-acbf-b1d0cca6013a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.640575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13245f-7709-444e-acbf-b1d0cca6013a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.640919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13245f-7709-444e-acbf-b1d0cca6013a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.642202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13245f-7709-444e-acbf-b1d0cca6013a None admin] RBAC: Adding query filter params (interface=public, service_id=11b116cf325f400f9b05a4c6451d397f, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:34.642514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13245f-7709-444e-acbf-b1d0cca6013a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.643879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13245f-7709-444e-acbf-b1d0cca6013a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.649603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 438/887] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 28 17:48:34 2022] GET /identity/v3/endpoints?service_id=11b116cf325f400f9b05a4c6451d397f&interface=public®ion_id=RegionOne => generated 194 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:34.658359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c27b76-cbd5-4985-be36-31fc35d1b857 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:34.710562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf3ca8-1950-4e6d-8367-320f16bd9549 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.710562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf3ca8-1950-4e6d-8367-320f16bd9549 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.710562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf3ca8-1950-4e6d-8367-320f16bd9549 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.710562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 439/888] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:34.718431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46309-e97a-4835-a2a0-c29eceabf4e2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.718708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46309-e97a-4835-a2a0-c29eceabf4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.719582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab46309-e97a-4835-a2a0-c29eceabf4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.764806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-eab46309-e97a-4835-a2a0-c29eceabf4e2 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:34.768805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-eab46309-e97a-4835-a2a0-c29eceabf4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:34.810510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c27b76-cbd5-4985-be36-31fc35d1b857 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:34.838814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:34.851338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0b408-94bf-4765-b879-703725d09c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:34.852070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0b408-94bf-4765-b879-703725d09c15 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:34.852407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0b408-94bf-4765-b879-703725d09c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:34.854065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0b408-94bf-4765-b879-703725d09c15 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:34.854065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0b408-94bf-4765-b879-703725d09c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:34.855055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0b408-94bf-4765-b879-703725d09c15 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:34.861571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 450/889] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 28 17:48:34 2022] GET /identity/v3/services => generated 1268 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:48:34.875395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 440/890] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:34.898521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0b408-94bf-4765-b879-703725d09c15 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:35.013296 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0b408-94bf-4765-b879-703725d09c15 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:35.049166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30e4ab-a2f3-4a22-bc80-b6d877904a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:35.049809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30e4ab-a2f3-4a22-bc80-b6d877904a1c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.050093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30e4ab-a2f3-4a22-bc80-b6d877904a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.050365 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30e4ab-a2f3-4a22-bc80-b6d877904a1c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.051053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30e4ab-a2f3-4a22-bc80-b6d877904a1c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:35.052418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30e4ab-a2f3-4a22-bc80-b6d877904a1c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-1d30e4ab-a2f3-4a22-bc80-b6d877904a1c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:35.061950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:35.062895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:35.065293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 451/891] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Jul 28 17:48:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:35.069880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab46309-e97a-4835-a2a0-c29eceabf4e2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:35.173647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:35.183861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab46309-e97a-4835-a2a0-c29eceabf4e2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:35.218753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a2a5-0b4b-4307-aa87-a7aca22020a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:35.219380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a2a5-0b4b-4307-aa87-a7aca22020a5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.219723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a2a5-0b4b-4307-aa87-a7aca22020a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.219999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a2a5-0b4b-4307-aa87-a7aca22020a5 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.220678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a2a5-0b4b-4307-aa87-a7aca22020a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:35.221011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a2a5-0b4b-4307-aa87-a7aca22020a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:35.222378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a2a5-0b4b-4307-aa87-a7aca22020a5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:35.227483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 441/892] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:35.233355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30e4ab-a2f3-4a22-bc80-b6d877904a1c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:35.288535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:35.340993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30e4ab-a2f3-4a22-bc80-b6d877904a1c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:35.376370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d340c3-c888-4ce7-84e7-dff889a98e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:35.377015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d340c3-c888-4ce7-84e7-dff889a98e6e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.377298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d340c3-c888-4ce7-84e7-dff889a98e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.377575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d340c3-c888-4ce7-84e7-dff889a98e6e None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.378255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d340c3-c888-4ce7-84e7-dff889a98e6e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:35.378561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d340c3-c888-4ce7-84e7-dff889a98e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:35.379935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d340c3-c888-4ce7-84e7-dff889a98e6e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:35.385522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 452/893] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:35.392122 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a2a5-0b4b-4307-aa87-a7aca22020a5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:35.475548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc771-87ae-4486-bc2b-9bcca4249482 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.476153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc771-87ae-4486-bc2b-9bcca4249482 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.476648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc771-87ae-4486-bc2b-9bcca4249482 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.479525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 453/894] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:35.483942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565ed6b-b144-4e58-9986-05598717c976 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.484226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565ed6b-b144-4e58-9986-05598717c976 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.484504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565ed6b-b144-4e58-9986-05598717c976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.501736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a2a5-0b4b-4307-aa87-a7aca22020a5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:35.509770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-6565ed6b-b144-4e58-9986-05598717c976 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:35.511397 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6565ed6b-b144-4e58-9986-05598717c976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:35.541728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7419d9-8f57-4de9-9347-55155dd36256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:35.542346 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7419d9-8f57-4de9-9347-55155dd36256 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.542629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7419d9-8f57-4de9-9347-55155dd36256 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.542906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7419d9-8f57-4de9-9347-55155dd36256 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.543778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7419d9-8f57-4de9-9347-55155dd36256 None admin] RBAC: Adding query filter params (interface=public, service_id=bda9be6938e141fb818d280f69d60a7e, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:35.544086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7419d9-8f57-4de9-9347-55155dd36256 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:35.545477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7419d9-8f57-4de9-9347-55155dd36256 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:35.555153 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 442/895] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 28 17:48:35 2022] GET /identity/v3/endpoints?service_id=bda9be6938e141fb818d280f69d60a7e&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:35.557016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7419d9-8f57-4de9-9347-55155dd36256 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:35.576964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:35.611721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 454/896] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:35.630133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565ed6b-b144-4e58-9986-05598717c976 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:35.679393 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7419d9-8f57-4de9-9347-55155dd36256 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:35.682049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:35.724703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cf552-8211-4a76-97c9-c8da713c60a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:35.725357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cf552-8211-4a76-97c9-c8da713c60a3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.725689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cf552-8211-4a76-97c9-c8da713c60a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.725911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cf552-8211-4a76-97c9-c8da713c60a3 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.726864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cf552-8211-4a76-97c9-c8da713c60a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:35.728227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cf552-8211-4a76-97c9-c8da713c60a3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:35.740944 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 443/897] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 28 17:48:35 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:48:35.743479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565ed6b-b144-4e58-9986-05598717c976 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:35.782898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686f7ca-c455-4951-a4fc-2cec29ec8485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:35.783519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686f7ca-c455-4951-a4fc-2cec29ec8485 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.783797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686f7ca-c455-4951-a4fc-2cec29ec8485 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.784067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686f7ca-c455-4951-a4fc-2cec29ec8485 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.784793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686f7ca-c455-4951-a4fc-2cec29ec8485 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:35.786205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686f7ca-c455-4951-a4fc-2cec29ec8485 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:35.835701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afecab-2615-4ff0-af78-409524a2e5ab None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.836043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afecab-2615-4ff0-af78-409524a2e5ab None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.836238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afecab-2615-4ff0-af78-409524a2e5ab None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.837903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 444/898] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:35.843261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f79a2c-c90a-4e28-9184-c2abe592046b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:35.843535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f79a2c-c90a-4e28-9184-c2abe592046b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:35.843792 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f79a2c-c90a-4e28-9184-c2abe592046b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:35.863288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f0f79a2c-c90a-4e28-9184-c2abe592046b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:35.864514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f0f79a2c-c90a-4e28-9184-c2abe592046b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:35.873717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 455/899] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:48:35 2022] POST /identity/v3/services => generated 241 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:35.959203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 445/900] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:35.983340 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686f7ca-c455-4951-a4fc-2cec29ec8485 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:36.096954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686f7ca-c455-4951-a4fc-2cec29ec8485 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:36.105901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:36.137931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30453987-faf7-4dec-a6f9-e136022552dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:36.138585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453987-faf7-4dec-a6f9-e136022552dd None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:36.138959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453987-faf7-4dec-a6f9-e136022552dd None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:36.139238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453987-faf7-4dec-a6f9-e136022552dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:36.151546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30453987-faf7-4dec-a6f9-e136022552dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-30453987-faf7-4dec-a6f9-e136022552dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:36.156625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:36.158152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:36.158994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 456/901] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 28 17:48:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:36.183089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f79a2c-c90a-4e28-9184-c2abe592046b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:36.184849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:36.279497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f79a2c-c90a-4e28-9184-c2abe592046b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:36.315838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae84f-2759-47f4-9887-38d4c2079055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:36.316452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae84f-2759-47f4-9887-38d4c2079055 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:36.316731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae84f-2759-47f4-9887-38d4c2079055 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:36.317032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfae84f-2759-47f4-9887-38d4c2079055 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:36.317742 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae84f-2759-47f4-9887-38d4c2079055 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:36.318042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae84f-2759-47f4-9887-38d4c2079055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:36.319388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfae84f-2759-47f4-9887-38d4c2079055 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:36.327733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 446/902] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 28 17:48:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:36.333140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30453987-faf7-4dec-a6f9-e136022552dd None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:36.441419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30453987-faf7-4dec-a6f9-e136022552dd None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:36.476072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e18a98-9820-4cc8-a66e-eaa8151f0b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:36.476718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e18a98-9820-4cc8-a66e-eaa8151f0b47 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:36.477022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e18a98-9820-4cc8-a66e-eaa8151f0b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:36.477295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e18a98-9820-4cc8-a66e-eaa8151f0b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:36.489117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e18a98-9820-4cc8-a66e-eaa8151f0b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:36.490586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e18a98-9820-4cc8-a66e-eaa8151f0b47 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-38e18a98-9820-4cc8-a66e-eaa8151f0b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:36.506379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:36.507353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:36.508239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:36.508239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:36.508239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:36.508239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:36.508239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 457/903] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:36.514521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae84f-2759-47f4-9887-38d4c2079055 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:36.584359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:36.618811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfae84f-2759-47f4-9887-38d4c2079055 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:36.653378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146c499-1453-48ca-bfd9-982f1d6455d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:36.654152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146c499-1453-48ca-bfd9-982f1d6455d1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:36.654481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146c499-1453-48ca-bfd9-982f1d6455d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:36.654752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146c499-1453-48ca-bfd9-982f1d6455d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:36.655435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146c499-1453-48ca-bfd9-982f1d6455d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:36.655733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146c499-1453-48ca-bfd9-982f1d6455d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:36.657160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146c499-1453-48ca-bfd9-982f1d6455d1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:36.669771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 447/904] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:36.675869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e18a98-9820-4cc8-a66e-eaa8151f0b47 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:36.696447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:36.777650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e18a98-9820-4cc8-a66e-eaa8151f0b47 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:36.811939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b8758-9680-47b3-86c3-0aeff90e86bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:36.812939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b8758-9680-47b3-86c3-0aeff90e86bb None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:36.813491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b8758-9680-47b3-86c3-0aeff90e86bb None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:36.813962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b8758-9680-47b3-86c3-0aeff90e86bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:36.821826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b8758-9680-47b3-86c3-0aeff90e86bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:36.823504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b8758-9680-47b3-86c3-0aeff90e86bb None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-609b8758-9680-47b3-86c3-0aeff90e86bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:36.837211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:36.838164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:36.839105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 458/905] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:48:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:36.842475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146c499-1453-48ca-bfd9-982f1d6455d1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:36.942982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146c499-1453-48ca-bfd9-982f1d6455d1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:36.972455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:36.980261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2df149-d3b6-4088-b766-98519fe24eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:36.980911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2df149-d3b6-4088-b766-98519fe24eee None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:36.981372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2df149-d3b6-4088-b766-98519fe24eee None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:36.981650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2df149-d3b6-4088-b766-98519fe24eee None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:36.982448 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2df149-d3b6-4088-b766-98519fe24eee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:36.982756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2df149-d3b6-4088-b766-98519fe24eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:36.984174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2df149-d3b6-4088-b766-98519fe24eee None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.002585 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 448/906] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 28 17:48:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:37.009934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b8758-9680-47b3-86c3-0aeff90e86bb None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.014176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39366-51fc-4bf8-85ee-4d2589ed37d9 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.014455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39366-51fc-4bf8-85ee-4d2589ed37d9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.014725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39366-51fc-4bf8-85ee-4d2589ed37d9 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.016297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 449/907] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:37.021925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887428b-2f9f-400f-b90e-14b41160110f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.022204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887428b-2f9f-400f-b90e-14b41160110f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.022588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887428b-2f9f-400f-b90e-14b41160110f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.042250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1887428b-2f9f-400f-b90e-14b41160110f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:37.043421 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1887428b-2f9f-400f-b90e-14b41160110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:37.101490 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.120932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 450/908] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:37.135242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b8758-9680-47b3-86c3-0aeff90e86bb None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.143695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887428b-2f9f-400f-b90e-14b41160110f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.181266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244cdaf-4454-4753-8ea2-8f6c5d1b96f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.181881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244cdaf-4454-4753-8ea2-8f6c5d1b96f5 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.182158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244cdaf-4454-4753-8ea2-8f6c5d1b96f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.182428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244cdaf-4454-4753-8ea2-8f6c5d1b96f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.263090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244cdaf-4454-4753-8ea2-8f6c5d1b96f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.265305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244cdaf-4454-4753-8ea2-8f6c5d1b96f5 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.279508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887428b-2f9f-400f-b90e-14b41160110f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.298310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.316947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b18072-4a62-43db-b4b1-a609393c9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.317714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b18072-4a62-43db-b4b1-a609393c9c38 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.318092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b18072-4a62-43db-b4b1-a609393c9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.318460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b18072-4a62-43db-b4b1-a609393c9c38 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.319247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b18072-4a62-43db-b4b1-a609393c9c38 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.320639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b18072-4a62-43db-b4b1-a609393c9c38 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-86b18072-4a62-43db-b4b1-a609393c9c38 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:37.330242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:37.331406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 17:48:37.332441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:37.339328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 451/909] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:37.341478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b18072-4a62-43db-b4b1-a609393c9c38 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.367001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.394495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 459/910] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:37.397133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244cdaf-4454-4753-8ea2-8f6c5d1b96f5 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.477175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b18072-4a62-43db-b4b1-a609393c9c38 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.524022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5ce96-237a-4e08-91bd-bbe3d34eed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.524609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244cdaf-4454-4753-8ea2-8f6c5d1b96f5 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.524924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5ce96-237a-4e08-91bd-bbe3d34eed8d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.525317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5ce96-237a-4e08-91bd-bbe3d34eed8d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.525686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5ce96-237a-4e08-91bd-bbe3d34eed8d None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.526474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5ce96-237a-4e08-91bd-bbe3d34eed8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:37.527143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5ce96-237a-4e08-91bd-bbe3d34eed8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.529590 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5ce96-237a-4e08-91bd-bbe3d34eed8d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.539981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 452/911] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:37.541626 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5ce96-237a-4e08-91bd-bbe3d34eed8d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.566080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb115097-4c87-4225-9fb9-18b91cd46f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.566727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb115097-4c87-4225-9fb9-18b91cd46f18 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.567011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb115097-4c87-4225-9fb9-18b91cd46f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.567284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb115097-4c87-4225-9fb9-18b91cd46f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.578642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb115097-4c87-4225-9fb9-18b91cd46f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.581335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb115097-4c87-4225-9fb9-18b91cd46f18 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.592112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-fb115097-4c87-4225-9fb9-18b91cd46f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:37.597863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:37.598737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:37.599706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:37.599706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:37.599706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:37.599706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:37.606914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 460/912] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:37.608498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb115097-4c87-4225-9fb9-18b91cd46f18 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.643833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.657693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5ce96-237a-4e08-91bd-bbe3d34eed8d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.693590 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b63d-0fb4-48fd-8d22-7e5ce21d02c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.694569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b63d-0fb4-48fd-8d22-7e5ce21d02c7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.695075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b63d-0fb4-48fd-8d22-7e5ce21d02c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.695535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b63d-0fb4-48fd-8d22-7e5ce21d02c7 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.696419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413b63d-0fb4-48fd-8d22-7e5ce21d02c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:37.696952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413b63d-0fb4-48fd-8d22-7e5ce21d02c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.698490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413b63d-0fb4-48fd-8d22-7e5ce21d02c7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.708553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 453/913] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:37.709656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b63d-0fb4-48fd-8d22-7e5ce21d02c7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.722450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb115097-4c87-4225-9fb9-18b91cd46f18 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.760823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d5316-8d6f-48c4-8654-469b637e3cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.761599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d5316-8d6f-48c4-8654-469b637e3cba None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.761819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d5316-8d6f-48c4-8654-469b637e3cba None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.762091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d5316-8d6f-48c4-8654-469b637e3cba None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.762783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d5316-8d6f-48c4-8654-469b637e3cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:37.763217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d5316-8d6f-48c4-8654-469b637e3cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.764588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d5316-8d6f-48c4-8654-469b637e3cba None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.782658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 461/914] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:37.783760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d5316-8d6f-48c4-8654-469b637e3cba None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.833991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b63d-0fb4-48fd-8d22-7e5ce21d02c7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.848002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.885655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8656a6-20dd-425c-9364-1e5c534305d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.886475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8656a6-20dd-425c-9364-1e5c534305d4 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.887015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8656a6-20dd-425c-9364-1e5c534305d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.887518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8656a6-20dd-425c-9364-1e5c534305d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.888565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8656a6-20dd-425c-9364-1e5c534305d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.890046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8656a6-20dd-425c-9364-1e5c534305d4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.908360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:37.914378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d5316-8d6f-48c4-8654-469b637e3cba None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:37.949002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12179af3-0f71-4ad2-a6db-74e6d5a0aaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:37.949637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12179af3-0f71-4ad2-a6db-74e6d5a0aaaa None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.949910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12179af3-0f71-4ad2-a6db-74e6d5a0aaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.950180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12179af3-0f71-4ad2-a6db-74e6d5a0aaaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.957264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12179af3-0f71-4ad2-a6db-74e6d5a0aaaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:37.959603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12179af3-0f71-4ad2-a6db-74e6d5a0aaaa None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-12179af3-0f71-4ad2-a6db-74e6d5a0aaaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:37.972240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:37.978249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 462/915] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501507e5-4975-42db-88b5-41048ce3ee80 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.979162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501507e5-4975-42db-88b5-41048ce3ee80 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.979776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501507e5-4975-42db-88b5-41048ce3ee80 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:37.979776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 463/916] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:37.979776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501507e5-4975-42db-88b5-41048ce3ee80 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:37.989744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 454/917] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 17:48:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:37.991442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed0a5a-4d78-41fa-a672-adb2a657fad4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:37.991736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed0a5a-4d78-41fa-a672-adb2a657fad4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:37.992011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed0a5a-4d78-41fa-a672-adb2a657fad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.011630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a7ed0a5a-4d78-41fa-a672-adb2a657fad4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:38.012917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a7ed0a5a-4d78-41fa-a672-adb2a657fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:38.105541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 455/918] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:38.107229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a757b5-51ae-43b0-a14d-ce07af076c2b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.109046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a757b5-51ae-43b0-a14d-ce07af076c2b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.109399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a757b5-51ae-43b0-a14d-ce07af076c2b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.111055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 456/919] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:38.118824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1db6d9-5410-4116-bde1-beccc12c40d5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.119209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1db6d9-5410-4116-bde1-beccc12c40d5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.119392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1db6d9-5410-4116-bde1-beccc12c40d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.142711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9b1db6d9-5410-4116-bde1-beccc12c40d5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:38.143418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501507e5-4975-42db-88b5-41048ce3ee80 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.143930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9b1db6d9-5410-4116-bde1-beccc12c40d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:38.188680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ad961-e755-4852-8ddd-3ee99961ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.189572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad961-e755-4852-8ddd-3ee99961ce31 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.189704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad961-e755-4852-8ddd-3ee99961ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.189873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ad961-e755-4852-8ddd-3ee99961ce31 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.190627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad961-e755-4852-8ddd-3ee99961ce31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:38.190935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad961-e755-4852-8ddd-3ee99961ce31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.192370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ad961-e755-4852-8ddd-3ee99961ce31 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.204942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 464/920] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:38.205768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ad961-e755-4852-8ddd-3ee99961ce31 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.218737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:38.230438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 457/921] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:38.231255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1db6d9-5410-4116-bde1-beccc12c40d5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.257650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:38.317348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ad961-e755-4852-8ddd-3ee99961ce31 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.340928 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1db6d9-5410-4116-bde1-beccc12c40d5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.354702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebe97e-11ff-4f60-ae38-91e707d7a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.355347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebe97e-11ff-4f60-ae38-91e707d7a523 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.355630 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebe97e-11ff-4f60-ae38-91e707d7a523 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.355905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebe97e-11ff-4f60-ae38-91e707d7a523 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.356532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebe97e-11ff-4f60-ae38-91e707d7a523 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.358068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebe97e-11ff-4f60-ae38-91e707d7a523 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-5cebe97e-11ff-4f60-ae38-91e707d7a523 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:38.368084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:38.369080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:38.370617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 465/922] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:38.371504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebe97e-11ff-4f60-ae38-91e707d7a523 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.383370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151f12-525f-4838-ad38-6c4f95dbf75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.383991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151f12-525f-4838-ad38-6c4f95dbf75d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.384266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151f12-525f-4838-ad38-6c4f95dbf75d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.384540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151f12-525f-4838-ad38-6c4f95dbf75d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.385362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd151f12-525f-4838-ad38-6c4f95dbf75d None admin] RBAC: Adding query filter params (role.id=4063288b76d14443b6b9f188c7d8dfd6, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=36f4189de0674590a257d9de7a60c63f) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:38.385671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd151f12-525f-4838-ad38-6c4f95dbf75d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.387103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd151f12-525f-4838-ad38-6c4f95dbf75d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.393226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 458/923] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/role_assignments?user.id=36f4189de0674590a257d9de7a60c63f&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=4063288b76d14443b6b9f188c7d8dfd6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:38.393835 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151f12-525f-4838-ad38-6c4f95dbf75d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.490474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:38.491111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:38.507369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151f12-525f-4838-ad38-6c4f95dbf75d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.526289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebe97e-11ff-4f60-ae38-91e707d7a523 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.545648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edab24-e969-4a37-827e-3ce92c529968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.546286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edab24-e969-4a37-827e-3ce92c529968 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.546570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edab24-e969-4a37-827e-3ce92c529968 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.546847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edab24-e969-4a37-827e-3ce92c529968 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.547592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edab24-e969-4a37-827e-3ce92c529968 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:38.547907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edab24-e969-4a37-827e-3ce92c529968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.549396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edab24-e969-4a37-827e-3ce92c529968 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.556047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 459/924] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:38.562261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edab24-e969-4a37-827e-3ce92c529968 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.576630 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19a18-68c2-416a-82d1-4d25ca62e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.577542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19a18-68c2-416a-82d1-4d25ca62e299 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.577845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19a18-68c2-416a-82d1-4d25ca62e299 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.578076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19a18-68c2-416a-82d1-4d25ca62e299 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.578724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19a18-68c2-416a-82d1-4d25ca62e299 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.580235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19a18-68c2-416a-82d1-4d25ca62e299 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-b8f19a18-68c2-416a-82d1-4d25ca62e299 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:38.589987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:38.591015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:38.591895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 466/925] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:38.598871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19a18-68c2-416a-82d1-4d25ca62e299 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.701103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edab24-e969-4a37-827e-3ce92c529968 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.705596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19a18-68c2-416a-82d1-4d25ca62e299 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.741566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f476-ac04-474e-946b-cc7a2e0d2d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.742166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f476-ac04-474e-946b-cc7a2e0d2d8d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.742362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f476-ac04-474e-946b-cc7a2e0d2d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.742630 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570f476-ac04-474e-946b-cc7a2e0d2d8d None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.743300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570f476-ac04-474e-946b-cc7a2e0d2d8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:38.743657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570f476-ac04-474e-946b-cc7a2e0d2d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.745202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570f476-ac04-474e-946b-cc7a2e0d2d8d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.748507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ebc5-c37b-47b1-9337-3fded9d6445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.749414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ebc5-c37b-47b1-9337-3fded9d6445d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.749839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ebc5-c37b-47b1-9337-3fded9d6445d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.750256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ebc5-c37b-47b1-9337-3fded9d6445d None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.755869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 467/926] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:38.756016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ebc5-c37b-47b1-9337-3fded9d6445d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:38.756016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ebc5-c37b-47b1-9337-3fded9d6445d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.756016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ebc5-c37b-47b1-9337-3fded9d6445d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.757468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f476-ac04-474e-946b-cc7a2e0d2d8d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.760763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:38.763684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 460/927] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:38.771545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ebc5-c37b-47b1-9337-3fded9d6445d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.785610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:38.870974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570f476-ac04-474e-946b-cc7a2e0d2d8d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.880998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ebc5-c37b-47b1-9337-3fded9d6445d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:38.913809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e83c-c3cd-467d-8fed-860da208fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.914250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e83c-c3cd-467d-8fed-860da208fac9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.914410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e83c-c3cd-467d-8fed-860da208fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.915600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e83c-c3cd-467d-8fed-860da208fac9 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.915600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e83c-c3cd-467d-8fed-860da208fac9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:38.915805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e83c-c3cd-467d-8fed-860da208fac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.917266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e83c-c3cd-467d-8fed-860da208fac9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.927054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 468/928] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:38.928164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e83c-c3cd-467d-8fed-860da208fac9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:38.932653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026421-8403-4c11-b7bd-5dea6ecc0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:38.933314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026421-8403-4c11-b7bd-5dea6ecc0738 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:38.933592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026421-8403-4c11-b7bd-5dea6ecc0738 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:38.933866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026421-8403-4c11-b7bd-5dea6ecc0738 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:38.934577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0026421-8403-4c11-b7bd-5dea6ecc0738 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:38.935938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0026421-8403-4c11-b7bd-5dea6ecc0738 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:38.999064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:39.044808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 461/929] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 17:48:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:39.051766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e83c-c3cd-467d-8fed-860da208fac9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:39.098014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e62a35-555c-48f9-87ab-f5e7fe0216e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:39.098697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e62a35-555c-48f9-87ab-f5e7fe0216e6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:39.098981 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e62a35-555c-48f9-87ab-f5e7fe0216e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:39.099303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e62a35-555c-48f9-87ab-f5e7fe0216e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:39.100069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e62a35-555c-48f9-87ab-f5e7fe0216e6 None admin] RBAC: Adding query filter params (interface=public, service_id=1d97f9d1a3f24026acb3a037752da52d, region_id=RegionOne) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:39.100375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e62a35-555c-48f9-87ab-f5e7fe0216e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:39.101965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e62a35-555c-48f9-87ab-f5e7fe0216e6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:39.108287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 469/930] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 28 17:48:38 2022] GET /identity/v3/endpoints?service_id=1d97f9d1a3f24026acb3a037752da52d&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:39.113843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026421-8403-4c11-b7bd-5dea6ecc0738 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:39.195478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:39.234879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026421-8403-4c11-b7bd-5dea6ecc0738 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:39.271634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109770d-99be-4b4b-b23d-d81832b86dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:39.272240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109770d-99be-4b4b-b23d-d81832b86dac None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:39.272527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109770d-99be-4b4b-b23d-d81832b86dac None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:39.272814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109770d-99be-4b4b-b23d-d81832b86dac None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:39.273616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109770d-99be-4b4b-b23d-d81832b86dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:39.274998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109770d-99be-4b4b-b23d-d81832b86dac None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:39.282878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 462/931] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 28 17:48:39 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:48:40.079970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a98fa-2d2e-4fd1-bdb2-71aa4e1043a1 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.080493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a98fa-2d2e-4fd1-bdb2-71aa4e1043a1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.080571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a98fa-2d2e-4fd1-bdb2-71aa4e1043a1 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.082202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 470/932] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:40.087160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a08fc-d3b0-40c5-8e86-79bb444b13b2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.087553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a08fc-d3b0-40c5-8e86-79bb444b13b2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.087720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a08fc-d3b0-40c5-8e86-79bb444b13b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.106651 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f17a08fc-d3b0-40c5-8e86-79bb444b13b2 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:40.107819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f17a08fc-d3b0-40c5-8e86-79bb444b13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:40.182720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 463/933] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:40.206354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a98fa-2d2e-4fd1-bdb2-71aa4e1043a1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:40.317079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a98fa-2d2e-4fd1-bdb2-71aa4e1043a1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:40.343465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:40.352524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d7af3-373c-4b47-bc30-24faf62d30f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:40.353176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d7af3-373c-4b47-bc30-24faf62d30f4 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.353459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d7af3-373c-4b47-bc30-24faf62d30f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.353738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d7af3-373c-4b47-bc30-24faf62d30f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.354429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d7af3-373c-4b47-bc30-24faf62d30f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:40.355980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d7af3-373c-4b47-bc30-24faf62d30f4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:40.358686 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WARNING keystone.server.flask.common [None req-723d7af3-373c-4b47-bc30-24faf62d30f4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 17:48:40.408087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.sql.core [None req-723d7af3-373c-4b47-bc30-24faf62d30f4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 17:48:40.408087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 17:48:40.408087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [parameters: {'id': 'c1df158b2e43425991572cb64c2c3ef6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 17:48:40.408087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80525) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-723d7af3-373c-4b47-bc30-24faf62d30f4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1df158b2e43425991572cb64c2c3ef6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1df158b2e43425991572cb64c2c3ef6. Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:48:40.425884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application result.read() Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 17:48:40.426790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application yield resource Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise self.value Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application session.commit() Jul 28 17:48:40.427749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self.session.flush() Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application compat.raise_( Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 17:48:40.428690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 17:48:40.429696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application result.read() Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:48:40.430489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [parameters: {'id': 'c1df158b2e43425991572cb64c2c3ef6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:40.431437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:40.436380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1df158b2e43425991572cb64c2c3ef6. Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:40.437805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 471/934] 10.222.0.67 () {60 vars in 1140 bytes} [Thu Jul 28 17:48:40 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:40.438531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a08fc-d3b0-40c5-8e86-79bb444b13b2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:40.445517 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8e59-1ff6-4dc2-9a6a-90cd52867054 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.445806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8e59-1ff6-4dc2-9a6a-90cd52867054 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.446090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8e59-1ff6-4dc2-9a6a-90cd52867054 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.450711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 472/935] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:40.456117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c32c3-7272-4a0f-b65b-276c816cf12f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.456408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c32c3-7272-4a0f-b65b-276c816cf12f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.456713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c32c3-7272-4a0f-b65b-276c816cf12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.486960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ef3c32c3-7272-4a0f-b65b-276c816cf12f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:40.489883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ef3c32c3-7272-4a0f-b65b-276c816cf12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:40.503555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:40.550589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a08fc-d3b0-40c5-8e86-79bb444b13b2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:40.592891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 473/936] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:40.598754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4be70-3bea-427e-875d-9e909724fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:40.599653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4be70-3bea-427e-875d-9e909724fe84 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.600230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4be70-3bea-427e-875d-9e909724fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.600700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4be70-3bea-427e-875d-9e909724fe84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.608022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4be70-3bea-427e-875d-9e909724fe84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:40.609731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4be70-3bea-427e-875d-9e909724fe84 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:40.615865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c32c3-7272-4a0f-b65b-276c816cf12f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4ae4be70-3bea-427e-875d-9e909724fe84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:40.625989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:40.626889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:40.627791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:40.627791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:40.627791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:40.627791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:40.627791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:40.627791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:40.627791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:40.627791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:40.630640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 464/937] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:40.636179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4be70-3bea-427e-875d-9e909724fe84 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:40.742260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4be70-3bea-427e-875d-9e909724fe84 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:40.745847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c32c3-7272-4a0f-b65b-276c816cf12f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:40.764988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:40.767584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:40.779540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f071fd-f8d3-4f73-aa55-7d7509712886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:40.780152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f071fd-f8d3-4f73-aa55-7d7509712886 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.780495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f071fd-f8d3-4f73-aa55-7d7509712886 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.780851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f071fd-f8d3-4f73-aa55-7d7509712886 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.784286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f071fd-f8d3-4f73-aa55-7d7509712886 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:40.784286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f071fd-f8d3-4f73-aa55-7d7509712886 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:40.784286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f071fd-f8d3-4f73-aa55-7d7509712886 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:40.792012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48cd5f-980d-44c4-8c18-1c9f485b7805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:40.792888 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48cd5f-980d-44c4-8c18-1c9f485b7805 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.793322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48cd5f-980d-44c4-8c18-1c9f485b7805 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.793734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48cd5f-980d-44c4-8c18-1c9f485b7805 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.805797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48cd5f-980d-44c4-8c18-1c9f485b7805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:40.808456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 465/938] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-de48cd5f-980d-44c4-8c18-1c9f485b7805 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:40.811356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:40.812651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:40.814217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:40.821615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 474/939] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 28 17:48:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:40.823362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f071fd-f8d3-4f73-aa55-7d7509712886 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:40.935190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f071fd-f8d3-4f73-aa55-7d7509712886 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:40.973763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3d13-e16e-46c6-a703-d76685dd7f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:40.974728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3d13-e16e-46c6-a703-d76685dd7f3e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:40.975183 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3d13-e16e-46c6-a703-d76685dd7f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:40.975629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3d13-e16e-46c6-a703-d76685dd7f3e None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:40.976530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f3d13-e16e-46c6-a703-d76685dd7f3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:40.977041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f3d13-e16e-46c6-a703-d76685dd7f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:40.978587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f3d13-e16e-46c6-a703-d76685dd7f3e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:40.989771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 466/940] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 28 17:48:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:40.994099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48cd5f-980d-44c4-8c18-1c9f485b7805 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.106923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48cd5f-980d-44c4-8c18-1c9f485b7805 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.143746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d705f2-ff36-4852-9f92-54020142d4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.144811 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d705f2-ff36-4852-9f92-54020142d4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.145295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d705f2-ff36-4852-9f92-54020142d4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.145768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d705f2-ff36-4852-9f92-54020142d4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.156491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d705f2-ff36-4852-9f92-54020142d4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.158464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d705f2-ff36-4852-9f92-54020142d4a2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-47d705f2-ff36-4852-9f92-54020142d4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:41.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:41.179379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:41.181098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:41.181098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:41.181098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:41.181098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:41.181098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 475/941] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:41.184357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3d13-e16e-46c6-a703-d76685dd7f3e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.211965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c812eb-05fe-4506-8007-566643d7008f None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.212235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c812eb-05fe-4506-8007-566643d7008f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.212429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c812eb-05fe-4506-8007-566643d7008f None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.214284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 476/942] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:41.219452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032e74-503b-41c2-bc0d-5dafe84476db None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.219739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032e74-503b-41c2-bc0d-5dafe84476db None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.220017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032e74-503b-41c2-bc0d-5dafe84476db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.236340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.240651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-28032e74-503b-41c2-bc0d-5dafe84476db None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:41.241885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-28032e74-503b-41c2-bc0d-5dafe84476db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:41.261329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.304553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3d13-e16e-46c6-a703-d76685dd7f3e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.321120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 477/943] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:41.340455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032e74-503b-41c2-bc0d-5dafe84476db None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.341625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c8f76-be0a-4798-b5a7-f6ad7bb14f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.342297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8f76-be0a-4798-b5a7-f6ad7bb14f32 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.342541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8f76-be0a-4798-b5a7-f6ad7bb14f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.342826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8f76-be0a-4798-b5a7-f6ad7bb14f32 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.344008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c8f76-be0a-4798-b5a7-f6ad7bb14f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:41.345179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c8f76-be0a-4798-b5a7-f6ad7bb14f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.346592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c8f76-be0a-4798-b5a7-f6ad7bb14f32 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.363140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 467/944] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:41.368815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c8f76-be0a-4798-b5a7-f6ad7bb14f32 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.455098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032e74-503b-41c2-bc0d-5dafe84476db None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.471693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c8f76-be0a-4798-b5a7-f6ad7bb14f32 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.474124 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.499326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8874b5-2673-4794-b4c5-af69f854f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.499961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8874b5-2673-4794-b4c5-af69f854f8fa None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.500240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8874b5-2673-4794-b4c5-af69f854f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.500510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8874b5-2673-4794-b4c5-af69f854f8fa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.501229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8874b5-2673-4794-b4c5-af69f854f8fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.502592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8874b5-2673-4794-b4c5-af69f854f8fa None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.510345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7a053-2342-4e26-ad26-d9ea997e3a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.510985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7a053-2342-4e26-ad26-d9ea997e3a34 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.511270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7a053-2342-4e26-ad26-d9ea997e3a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-6c8874b5-2673-4794-b4c5-af69f854f8fa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:41.511369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:41.512298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:48:41.513584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:41.514544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7a053-2342-4e26-ad26-d9ea997e3a34 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.514626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 478/945] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:41.514626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baafb6-c4b1-41b3-9ff7-249139b1131a None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.514626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baafb6-c4b1-41b3-9ff7-249139b1131a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.514626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baafb6-c4b1-41b3-9ff7-249139b1131a None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.515830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 479/946] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:41.520231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baafb6-c4b1-41b3-9ff7-249139b1131a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.526580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7a053-2342-4e26-ad26-d9ea997e3a34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.527983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7a053-2342-4e26-ad26-d9ea997e3a34 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.539507 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b7d7a053-2342-4e26-ad26-d9ea997e3a34 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:41.544134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:41.545115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:41.546076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 468/947] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:41.546656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103f21b-2230-464d-830c-8748953ec984 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.547252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103f21b-2230-464d-830c-8748953ec984 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.547252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103f21b-2230-464d-830c-8748953ec984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.566434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1103f21b-2230-464d-830c-8748953ec984 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:41.567627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1103f21b-2230-464d-830c-8748953ec984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:41.631615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baafb6-c4b1-41b3-9ff7-249139b1131a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.641701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 469/948] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:41.642718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103f21b-2230-464d-830c-8748953ec984 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.666729 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e736a0f-3961-4705-beda-b627c930e22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.667350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e736a0f-3961-4705-beda-b627c930e22c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.667628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e736a0f-3961-4705-beda-b627c930e22c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.667902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e736a0f-3961-4705-beda-b627c930e22c None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.668701 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e736a0f-3961-4705-beda-b627c930e22c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:41.669036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e736a0f-3961-4705-beda-b627c930e22c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.670491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e736a0f-3961-4705-beda-b627c930e22c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.680248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 480/949] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:41.680248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e736a0f-3961-4705-beda-b627c930e22c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.758547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.770855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:41.772548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103f21b-2230-464d-830c-8748953ec984 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.788620 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e736a0f-3961-4705-beda-b627c930e22c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.807464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fac61b-6df4-4fec-a7e3-c3dadcc45101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.808087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fac61b-6df4-4fec-a7e3-c3dadcc45101 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.808409 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fac61b-6df4-4fec-a7e3-c3dadcc45101 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.808677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fac61b-6df4-4fec-a7e3-c3dadcc45101 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.810839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fac61b-6df4-4fec-a7e3-c3dadcc45101 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:41.810839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fac61b-6df4-4fec-a7e3-c3dadcc45101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.811263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fac61b-6df4-4fec-a7e3-c3dadcc45101 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.822786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945349f-86e0-4166-859c-67feee03ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.823425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945349f-86e0-4166-859c-67feee03ea16 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.823705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945349f-86e0-4166-859c-67feee03ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.823977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945349f-86e0-4166-859c-67feee03ea16 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.824603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945349f-86e0-4166-859c-67feee03ea16 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.826079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945349f-86e0-4166-859c-67feee03ea16 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:41.834251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 470/950] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:41.834251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fac61b-6df4-4fec-a7e3-c3dadcc45101 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-f945349f-86e0-4166-859c-67feee03ea16 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:41.841570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:41.842732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:41.843757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:41.847154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 481/951] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:41.847924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945349f-86e0-4166-859c-67feee03ea16 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:41.945477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fac61b-6df4-4fec-a7e3-c3dadcc45101 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.957377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945349f-86e0-4166-859c-67feee03ea16 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:41.981523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9773d-fdae-47f6-883b-678af737ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:41.982146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9773d-fdae-47f6-883b-678af737ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:41.982498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9773d-fdae-47f6-883b-678af737ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:41.982838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9773d-fdae-47f6-883b-678af737ecf7 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:41.983614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9773d-fdae-47f6-883b-678af737ecf7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:41.984108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9773d-fdae-47f6-883b-678af737ecf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:41.986026 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9773d-fdae-47f6-883b-678af737ecf7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.001267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 471/952] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:42.001267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9773d-fdae-47f6-883b-678af737ecf7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.004471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da791d6-e4ac-41e2-b6bc-aa6eda40b56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.005263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da791d6-e4ac-41e2-b6bc-aa6eda40b56c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.005620 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da791d6-e4ac-41e2-b6bc-aa6eda40b56c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.005972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da791d6-e4ac-41e2-b6bc-aa6eda40b56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.019032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da791d6-e4ac-41e2-b6bc-aa6eda40b56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.021508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da791d6-e4ac-41e2-b6bc-aa6eda40b56c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.027416 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.031532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-5da791d6-e4ac-41e2-b6bc-aa6eda40b56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:42.046080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:42.047303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:42.049030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:42.049030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:42.049030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:42.049030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:42.049030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 482/953] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:42.052892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da791d6-e4ac-41e2-b6bc-aa6eda40b56c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.130904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9773d-fdae-47f6-883b-678af737ecf7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.181701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe582e1-d630-4b3e-9cd6-0915e778ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.182334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe582e1-d630-4b3e-9cd6-0915e778ad1f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.182619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe582e1-d630-4b3e-9cd6-0915e778ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.182894 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe582e1-d630-4b3e-9cd6-0915e778ad1f None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.183638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe582e1-d630-4b3e-9cd6-0915e778ad1f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:42.183943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe582e1-d630-4b3e-9cd6-0915e778ad1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.185602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe582e1-d630-4b3e-9cd6-0915e778ad1f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.192173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 472/954] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:42.196518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da791d6-e4ac-41e2-b6bc-aa6eda40b56c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.198700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe582e1-d630-4b3e-9cd6-0915e778ad1f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.236364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1615-5269-477d-853e-dbfd787189c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.237383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1615-5269-477d-853e-dbfd787189c1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.237724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1615-5269-477d-853e-dbfd787189c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.238064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1615-5269-477d-853e-dbfd787189c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.238824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1615-5269-477d-853e-dbfd787189c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:42.239244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1615-5269-477d-853e-dbfd787189c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.240767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1615-5269-477d-853e-dbfd787189c1 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.253805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 483/955] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:42.259352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1615-5269-477d-853e-dbfd787189c1 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.295972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.319651 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe582e1-d630-4b3e-9cd6-0915e778ad1f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.325987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.369085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376678-06ad-4186-9ffb-59fd4ad94a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.370043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376678-06ad-4186-9ffb-59fd4ad94a6b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.370321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1615-5269-477d-853e-dbfd787189c1 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.371099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376678-06ad-4186-9ffb-59fd4ad94a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.371525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376678-06ad-4186-9ffb-59fd4ad94a6b None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.372352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38376678-06ad-4186-9ffb-59fd4ad94a6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:42.373121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38376678-06ad-4186-9ffb-59fd4ad94a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.376162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38376678-06ad-4186-9ffb-59fd4ad94a6b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.383031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 473/956] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:42.388343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376678-06ad-4186-9ffb-59fd4ad94a6b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.413488 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb7135-62ab-4448-a2f4-31644ccc24f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.414506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7135-62ab-4448-a2f4-31644ccc24f0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.415002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7135-62ab-4448-a2f4-31644ccc24f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.415493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7135-62ab-4448-a2f4-31644ccc24f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.423063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb7135-62ab-4448-a2f4-31644ccc24f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.424880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb7135-62ab-4448-a2f4-31644ccc24f0 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-6cfb7135-62ab-4448-a2f4-31644ccc24f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:42.437145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:42.438680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:42.439573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:42.439573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:42.439573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:42.439573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:42.439573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:42.439573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:42.439573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:42.439573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:42.446702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 484/957] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:42.447853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb7135-62ab-4448-a2f4-31644ccc24f0 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.505954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38376678-06ad-4186-9ffb-59fd4ad94a6b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.541705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754cbe5-9b48-4ae6-a7ab-3de69e05361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.542326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754cbe5-9b48-4ae6-a7ab-3de69e05361e None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.542604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754cbe5-9b48-4ae6-a7ab-3de69e05361e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.542960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754cbe5-9b48-4ae6-a7ab-3de69e05361e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.543667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754cbe5-9b48-4ae6-a7ab-3de69e05361e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.545173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754cbe5-9b48-4ae6-a7ab-3de69e05361e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.562173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb7135-62ab-4448-a2f4-31644ccc24f0 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.581912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.599344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c24922-256d-47f4-a787-6c21a4606751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.599966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24922-256d-47f4-a787-6c21a4606751 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.600244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24922-256d-47f4-a787-6c21a4606751 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.600568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24922-256d-47f4-a787-6c21a4606751 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.601360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c24922-256d-47f4-a787-6c21a4606751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:42.601671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c24922-256d-47f4-a787-6c21a4606751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.603126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c24922-256d-47f4-a787-6c21a4606751 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.620258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 485/958] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:42.621252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c24922-256d-47f4-a787-6c21a4606751 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:42.723478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c24922-256d-47f4-a787-6c21a4606751 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:42.734600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:42.748133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 474/959] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 17:48:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:42.770225 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03646e-c308-4874-ad15-05453ce448fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:42.771151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03646e-c308-4874-ad15-05453ce448fc None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.771436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03646e-c308-4874-ad15-05453ce448fc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.771903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03646e-c308-4874-ad15-05453ce448fc None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/36f4189de0674590a257d9de7a60c63f/roles/4063288b76d14443b6b9f188c7d8dfd6` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.774536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03646e-c308-4874-ad15-05453ce448fc None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=36f4189de0674590a257d9de7a60c63f, role_id=4063288b76d14443b6b9f188c7d8dfd6)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:42.776012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03646e-c308-4874-ad15-05453ce448fc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:42.900893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 486/960] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:42 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/36f4189de0674590a257d9de7a60c63f/roles/4063288b76d14443b6b9f188c7d8dfd6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:42.995717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed568d-b97c-44fa-82dd-3f8f1eaf47de None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:42.996395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed568d-b97c-44fa-82dd-3f8f1eaf47de None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:42.996918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed568d-b97c-44fa-82dd-3f8f1eaf47de None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:42.998844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 475/961] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:43.006906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68b64e-3aca-4db1-aa5f-33f631613904 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:43.007558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68b64e-3aca-4db1-aa5f-33f631613904 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:43.008036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68b64e-3aca-4db1-aa5f-33f631613904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:43.028343 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-1c68b64e-3aca-4db1-aa5f-33f631613904 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:43.029959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1c68b64e-3aca-4db1-aa5f-33f631613904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:43.061474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:43.106273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 487/962] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:43.134771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed568d-b97c-44fa-82dd-3f8f1eaf47de None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:43.251861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed568d-b97c-44fa-82dd-3f8f1eaf47de None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:43.286475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:43.287096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:43.287377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:43.287653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:43.288334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:43.289851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:43.292446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING keystone.server.flask.common [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 17:48:43.333238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.sql.core [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 17:48:43.333238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 17:48:43.333238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [parameters: {'user_id': 'ed8134fa698e413189602530d30f8e4c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 17:48:43.333238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80524) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result.read() Jul 28 17:48:43.341069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:48:43.343108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application yield resource Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application next(self.gen) Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise self.value Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application session.commit() Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 17:48:43.344114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.session.flush() Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application compat.raise_( Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 17:48:43.345087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 17:48:43.345983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application conn.query(q) Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result.read() Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 17:48:43.346844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ed8134fa698e413189602530d30f8e4c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:43.348979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 17:48:43.350882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 17:48:43.353227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 17:48:43.353227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 17:48:43.353227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 17:48:43.353227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 17:48:43.353227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 17:48:43.353227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:43.353227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 476/963] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 28 17:48:43 2022] POST /identity/v3/users => generated 160 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:43.354130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68b64e-3aca-4db1-aa5f-33f631613904 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:43.457449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68b64e-3aca-4db1-aa5f-33f631613904 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:43.492737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ba817-bf23-4c73-bc99-c45640d5cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:43.493416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ba817-bf23-4c73-bc99-c45640d5cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:43.493695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ba817-bf23-4c73-bc99-c45640d5cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:43.493967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ba817-bf23-4c73-bc99-c45640d5cfc0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:43.501791 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ba817-bf23-4c73-bc99-c45640d5cfc0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:43.503232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ba817-bf23-4c73-bc99-c45640d5cfc0 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-846ba817-bf23-4c73-bc99-c45640d5cfc0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:43.515100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:43.516826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:43.517802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 488/964] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:43.522773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:43.588383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:43.627972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adc56-ca93-45b2-aa66-f3b47d2f6c86 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:43.665099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8432fbb-4ef3-4721-9698-726d3eca45d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:43.665721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8432fbb-4ef3-4721-9698-726d3eca45d4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:43.666002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8432fbb-4ef3-4721-9698-726d3eca45d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:43.666278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8432fbb-4ef3-4721-9698-726d3eca45d4 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:43.667046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8432fbb-4ef3-4721-9698-726d3eca45d4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:43.667352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8432fbb-4ef3-4721-9698-726d3eca45d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:43.669115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8432fbb-4ef3-4721-9698-726d3eca45d4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:43.709438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 477/965] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 28 17:48:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:44.093812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55cf2c-4b8c-40d7-b0ac-0f46d039aa4e None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:44.094020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55cf2c-4b8c-40d7-b0ac-0f46d039aa4e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:44.094306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55cf2c-4b8c-40d7-b0ac-0f46d039aa4e None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:44.095682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 489/966] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:44.101078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07b525-75dd-4130-a0c7-58eb53469bda None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:44.101378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07b525-75dd-4130-a0c7-58eb53469bda None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:44.101641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07b525-75dd-4130-a0c7-58eb53469bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:44.120193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ea07b525-75dd-4130-a0c7-58eb53469bda None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:44.121719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ea07b525-75dd-4130-a0c7-58eb53469bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:44.195688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 478/967] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:44.217692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55cf2c-4b8c-40d7-b0ac-0f46d039aa4e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:44.243137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:44.320994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55cf2c-4b8c-40d7-b0ac-0f46d039aa4e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:44.353305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482cf9-fe13-4a73-9fff-4a2b58c2dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:44.353843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482cf9-fe13-4a73-9fff-4a2b58c2dae0 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:44.354118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482cf9-fe13-4a73-9fff-4a2b58c2dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:44.354387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482cf9-fe13-4a73-9fff-4a2b58c2dae0 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:44.355070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1482cf9-fe13-4a73-9fff-4a2b58c2dae0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:44.356416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1482cf9-fe13-4a73-9fff-4a2b58c2dae0 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:44.456812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 490/968] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:48:44 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:44.834400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b4006-d668-47a0-8efb-1f4647f7835d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:44.834921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b4006-d668-47a0-8efb-1f4647f7835d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:44.834921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b4006-d668-47a0-8efb-1f4647f7835d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:44.836446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 479/969] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:44.842806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cdf42-8195-4be5-af63-c07d165b1bdd None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:44.843096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cdf42-8195-4be5-af63-c07d165b1bdd None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:44.843372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cdf42-8195-4be5-af63-c07d165b1bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:44.863979 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a80cdf42-8195-4be5-af63-c07d165b1bdd None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:44.865194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a80cdf42-8195-4be5-af63-c07d165b1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:44.938709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 491/970] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:44.961368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b4006-d668-47a0-8efb-1f4647f7835d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.012492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.056127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3acf9-7579-4fca-826c-64a0c41106dd None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.056415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3acf9-7579-4fca-826c-64a0c41106dd None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.056688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3acf9-7579-4fca-826c-64a0c41106dd None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.058193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 492/971] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:45.062991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601644e-962b-4c39-b53b-7b55aed67c2b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.063808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601644e-962b-4c39-b53b-7b55aed67c2b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.064037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601644e-962b-4c39-b53b-7b55aed67c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.064988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b4006-d668-47a0-8efb-1f4647f7835d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.082300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8601644e-962b-4c39-b53b-7b55aed67c2b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:45.083581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8601644e-962b-4c39-b53b-7b55aed67c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:45.086681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.101683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffb50d-12b9-4695-a3e8-41eebdb22158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.105764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffb50d-12b9-4695-a3e8-41eebdb22158 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.105764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffb50d-12b9-4695-a3e8-41eebdb22158 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.105764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffb50d-12b9-4695-a3e8-41eebdb22158 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.105764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffb50d-12b9-4695-a3e8-41eebdb22158 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.105764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffb50d-12b9-4695-a3e8-41eebdb22158 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0bffb50d-12b9-4695-a3e8-41eebdb22158 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:45.115375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:45.116512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:45.117417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:45.122047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 480/972] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:45.122931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffb50d-12b9-4695-a3e8-41eebdb22158 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.180830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 493/973] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:45.203066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601644e-962b-4c39-b53b-7b55aed67c2b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.248920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffb50d-12b9-4695-a3e8-41eebdb22158 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.262761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.285510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e36d87-a216-4541-8226-6351d9a5bfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.286930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e36d87-a216-4541-8226-6351d9a5bfaf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.287416 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e36d87-a216-4541-8226-6351d9a5bfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.288311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e36d87-a216-4541-8226-6351d9a5bfaf None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.289504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e36d87-a216-4541-8226-6351d9a5bfaf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:45.289964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e36d87-a216-4541-8226-6351d9a5bfaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.292391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e36d87-a216-4541-8226-6351d9a5bfaf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.299510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 481/974] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:45.304436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e36d87-a216-4541-8226-6351d9a5bfaf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.314896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601644e-962b-4c39-b53b-7b55aed67c2b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.350494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222af943-781d-45fb-8058-246068011be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.351057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222af943-781d-45fb-8058-246068011be5 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.351339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222af943-781d-45fb-8058-246068011be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.351612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222af943-781d-45fb-8058-246068011be5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.359438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.362915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222af943-781d-45fb-8058-246068011be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-222af943-781d-45fb-8058-246068011be5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:45.367788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:45.368742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:45.369621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 494/975] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:45.374774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222af943-781d-45fb-8058-246068011be5 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.414488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e36d87-a216-4541-8226-6351d9a5bfaf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.450472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c592-cfb8-484e-9712-02c7104f2525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.451090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c592-cfb8-484e-9712-02c7104f2525 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.451366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c592-cfb8-484e-9712-02c7104f2525 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.451634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c592-cfb8-484e-9712-02c7104f2525 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.452305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04c592-cfb8-484e-9712-02c7104f2525 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:45.452606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04c592-cfb8-484e-9712-02c7104f2525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.454047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04c592-cfb8-484e-9712-02c7104f2525 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.463734 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 482/976] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:45.464690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c592-cfb8-484e-9712-02c7104f2525 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.482923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222af943-781d-45fb-8058-246068011be5 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.507526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.524527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fecc7-f47c-483b-9060-d2084b231412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.525233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fecc7-f47c-483b-9060-d2084b231412 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.525670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fecc7-f47c-483b-9060-d2084b231412 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.525950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fecc7-f47c-483b-9060-d2084b231412 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.527261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fecc7-f47c-483b-9060-d2084b231412 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:45.527566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fecc7-f47c-483b-9060-d2084b231412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.528961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fecc7-f47c-483b-9060-d2084b231412 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.540836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 495/977] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:45.546317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fecc7-f47c-483b-9060-d2084b231412 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.565043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c592-cfb8-484e-9712-02c7104f2525 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.603238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd373b0-9c10-4d5f-8124-125e208b09cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.603788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd373b0-9c10-4d5f-8124-125e208b09cb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.604088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd373b0-9c10-4d5f-8124-125e208b09cb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.604340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd373b0-9c10-4d5f-8124-125e208b09cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.605201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd373b0-9c10-4d5f-8124-125e208b09cb None admin] RBAC: Adding query filter params (interface=admin, service_id=1d97f9d1a3f24026acb3a037752da52d, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:45.605533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd373b0-9c10-4d5f-8124-125e208b09cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.607051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd373b0-9c10-4d5f-8124-125e208b09cb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.617064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 483/978] 10.222.0.67 () {56 vars in 1249 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/endpoints?service_id=1d97f9d1a3f24026acb3a037752da52d&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:45.618244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd373b0-9c10-4d5f-8124-125e208b09cb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.621181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.662322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fecc7-f47c-483b-9060-d2084b231412 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.700648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ab6f-39a9-48a8-858c-73f56c117db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.701306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ab6f-39a9-48a8-858c-73f56c117db6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.701613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ab6f-39a9-48a8-858c-73f56c117db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.702657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ab6f-39a9-48a8-858c-73f56c117db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.713876 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ab6f-39a9-48a8-858c-73f56c117db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.715310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ab6f-39a9-48a8-858c-73f56c117db6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.724961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd373b0-9c10-4d5f-8124-125e208b09cb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-7971ab6f-39a9-48a8-858c-73f56c117db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:45.729614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:45.730495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:45.731395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:45.731395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:45.731395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:45.731395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:45.731395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 496/979] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:45.736928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ab6f-39a9-48a8-858c-73f56c117db6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:45.738125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.764873 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804b51-1be3-46db-8965-370e2bccebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.765487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804b51-1be3-46db-8965-370e2bccebe7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.765769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804b51-1be3-46db-8965-370e2bccebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.766084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804b51-1be3-46db-8965-370e2bccebe7 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.766749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7804b51-1be3-46db-8965-370e2bccebe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.768220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7804b51-1be3-46db-8965-370e2bccebe7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.774892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 484/980] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:48:45.847496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ab6f-39a9-48a8-858c-73f56c117db6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:45.863463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:45.884946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130b0fd-620b-432f-9f22-fdebc257bb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:45.885575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130b0fd-620b-432f-9f22-fdebc257bb47 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:45.885923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130b0fd-620b-432f-9f22-fdebc257bb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:45.886222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130b0fd-620b-432f-9f22-fdebc257bb47 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:45.887105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130b0fd-620b-432f-9f22-fdebc257bb47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:45.887412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130b0fd-620b-432f-9f22-fdebc257bb47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:45.888831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130b0fd-620b-432f-9f22-fdebc257bb47 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:45.908173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 497/981] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:45.909701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804b51-1be3-46db-8965-370e2bccebe7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:46.017230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804b51-1be3-46db-8965-370e2bccebe7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:46.051178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d30c4-7935-4b8c-9701-1f1ce25fa541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:46.051819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d30c4-7935-4b8c-9701-1f1ce25fa541 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.052096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d30c4-7935-4b8c-9701-1f1ce25fa541 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.052368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d30c4-7935-4b8c-9701-1f1ce25fa541 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.059932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d30c4-7935-4b8c-9701-1f1ce25fa541 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:46.061402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d30c4-7935-4b8c-9701-1f1ce25fa541 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a78d30c4-7935-4b8c-9701-1f1ce25fa541 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:46.075046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:46.076069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 17:48:46.077185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:46.078485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 485/982] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:48:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:46.082533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130b0fd-620b-432f-9f22-fdebc257bb47 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:46.186052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130b0fd-620b-432f-9f22-fdebc257bb47 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:46.223114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793c1c5-3826-4a21-9aa9-94253174cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:46.223789 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793c1c5-3826-4a21-9aa9-94253174cc70 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.224070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793c1c5-3826-4a21-9aa9-94253174cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.224344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793c1c5-3826-4a21-9aa9-94253174cc70 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.225231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793c1c5-3826-4a21-9aa9-94253174cc70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:46.225540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793c1c5-3826-4a21-9aa9-94253174cc70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:46.226955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793c1c5-3826-4a21-9aa9-94253174cc70 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:46.244639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 498/983] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 28 17:48:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:46.250445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d30c4-7935-4b8c-9701-1f1ce25fa541 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:46.283386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:46.353540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d30c4-7935-4b8c-9701-1f1ce25fa541 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:46.386895 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f8c1-2623-4114-a759-9e9654520ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:46.387514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f8c1-2623-4114-a759-9e9654520ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.387843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f8c1-2623-4114-a759-9e9654520ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.388069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f8c1-2623-4114-a759-9e9654520ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.456203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f8c1-2623-4114-a759-9e9654520ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:46.457602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f8c1-2623-4114-a759-9e9654520ae4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:46.486999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:46.496917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f02355-5e4a-4f89-bc98-a2d67af4555e None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.497414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f02355-5e4a-4f89-bc98-a2d67af4555e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.501496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f02355-5e4a-4f89-bc98-a2d67af4555e None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.501496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 499/984] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:46.504553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832bae-b634-49f8-85da-81745ae4253c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.504955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832bae-b634-49f8-85da-81745ae4253c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.505236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd832bae-b634-49f8-85da-81745ae4253c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.523246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-dd832bae-b634-49f8-85da-81745ae4253c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:46.524427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-dd832bae-b634-49f8-85da-81745ae4253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:46.552664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:46.574514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 486/985] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:48:46.575958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f8c1-2623-4114-a759-9e9654520ae4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:46.597427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 500/986] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:46.619847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd832bae-b634-49f8-85da-81745ae4253c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:46.687486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f8c1-2623-4114-a759-9e9654520ae4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:46.718889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:46.721034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd832bae-b634-49f8-85da-81745ae4253c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:46.725254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2bbb1-2d93-43e7-b9cd-ef21432811db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:46.725896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2bbb1-2d93-43e7-b9cd-ef21432811db None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.726174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2bbb1-2d93-43e7-b9cd-ef21432811db None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.726446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2bbb1-2d93-43e7-b9cd-ef21432811db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.737500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2bbb1-2d93-43e7-b9cd-ef21432811db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:46.739263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2bbb1-2d93-43e7-b9cd-ef21432811db None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ede2bbb1-2d93-43e7-b9cd-ef21432811db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:46.755014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:46.755961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:46.756892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:46.756892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:46.756892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:46.756892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:46.758502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417732-1c3d-4ee2-a307-57baf5ac3279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:46.759142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417732-1c3d-4ee2-a307-57baf5ac3279 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.759422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417732-1c3d-4ee2-a307-57baf5ac3279 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.759693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37417732-1c3d-4ee2-a307-57baf5ac3279 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.760313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37417732-1c3d-4ee2-a307-57baf5ac3279 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:46.760810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 487/987] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:46.761588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2bbb1-2d93-43e7-b9cd-ef21432811db None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:46.761981 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37417732-1c3d-4ee2-a307-57baf5ac3279 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-37417732-1c3d-4ee2-a307-57baf5ac3279 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:46.772635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:46.773814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:46.774824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 501/988] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:46.779761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417732-1c3d-4ee2-a307-57baf5ac3279 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:46.810227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:46.867110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2bbb1-2d93-43e7-b9cd-ef21432811db None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:46.897200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37417732-1c3d-4ee2-a307-57baf5ac3279 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:46.904120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a41bf-b962-46fd-8ba1-f32230f612c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:46.904737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a41bf-b962-46fd-8ba1-f32230f612c9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.905041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a41bf-b962-46fd-8ba1-f32230f612c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.905316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a41bf-b962-46fd-8ba1-f32230f612c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.905994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a41bf-b962-46fd-8ba1-f32230f612c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:46.906293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a41bf-b962-46fd-8ba1-f32230f612c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:46.908204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a41bf-b962-46fd-8ba1-f32230f612c9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:46.920595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 488/989] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:46.926767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a41bf-b962-46fd-8ba1-f32230f612c9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:46.940401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b683-e399-4452-af6c-110cfe22bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:46.941127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b683-e399-4452-af6c-110cfe22bb39 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:46.941470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b683-e399-4452-af6c-110cfe22bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:46.941948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b683-e399-4452-af6c-110cfe22bb39 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:46.942554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359b683-e399-4452-af6c-110cfe22bb39 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:46.942987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359b683-e399-4452-af6c-110cfe22bb39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:46.944352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359b683-e399-4452-af6c-110cfe22bb39 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:46.949878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 502/990] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:46.955286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b683-e399-4452-af6c-110cfe22bb39 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:46.971098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:47.029478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a41bf-b962-46fd-8ba1-f32230f612c9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:47.052504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:47.062917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b683-e399-4452-af6c-110cfe22bb39 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:47.064567 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a624a8d-c833-4926-b201-ac4fb8a0df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:47.065233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a624a8d-c833-4926-b201-ac4fb8a0df81 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.065506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a624a8d-c833-4926-b201-ac4fb8a0df81 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.065773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a624a8d-c833-4926-b201-ac4fb8a0df81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.072450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a624a8d-c833-4926-b201-ac4fb8a0df81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:47.073910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a624a8d-c833-4926-b201-ac4fb8a0df81 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1a624a8d-c833-4926-b201-ac4fb8a0df81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:47.084972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:47.086038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 489/991] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:47.091986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a624a8d-c833-4926-b201-ac4fb8a0df81 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:47.106933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d8f34-9118-4596-988a-bc94d396ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:47.107547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d8f34-9118-4596-988a-bc94d396ac80 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.107822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d8f34-9118-4596-988a-bc94d396ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.108303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d8f34-9118-4596-988a-bc94d396ac80 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.108757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d8f34-9118-4596-988a-bc94d396ac80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:47.109099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d8f34-9118-4596-988a-bc94d396ac80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:47.111020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d8f34-9118-4596-988a-bc94d396ac80 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:47.116691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 503/992] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:47.122159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d8f34-9118-4596-988a-bc94d396ac80 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:47.219295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a624a8d-c833-4926-b201-ac4fb8a0df81 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:47.221886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:47.233375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d8f34-9118-4596-988a-bc94d396ac80 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:47.261377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c298efd-9b41-4da1-ad35-ed2709259752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:47.261978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298efd-9b41-4da1-ad35-ed2709259752 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.262260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298efd-9b41-4da1-ad35-ed2709259752 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.262532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298efd-9b41-4da1-ad35-ed2709259752 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.263456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c298efd-9b41-4da1-ad35-ed2709259752 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:47.263761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c298efd-9b41-4da1-ad35-ed2709259752 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:47.265324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c298efd-9b41-4da1-ad35-ed2709259752 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:47.268584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b6ae7-a8f1-4894-8cd3-06179302e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:47.269229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b6ae7-a8f1-4894-8cd3-06179302e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.269507 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b6ae7-a8f1-4894-8cd3-06179302e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.269779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b6ae7-a8f1-4894-8cd3-06179302e8c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.270523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b6ae7-a8f1-4894-8cd3-06179302e8c3 None admin] RBAC: Adding query filter params (interface=public, service_id=3456f8498b414cb5aecd7b8ec59d28ac, region_id=RegionOne) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:47.270834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b6ae7-a8f1-4894-8cd3-06179302e8c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:47.272188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b6ae7-a8f1-4894-8cd3-06179302e8c3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:47.277811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 490/993] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:47.282804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 504/994] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 28 17:48:47 2022] GET /identity/v3/endpoints?service_id=3456f8498b414cb5aecd7b8ec59d28ac&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:47.284039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c298efd-9b41-4da1-ad35-ed2709259752 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:47.284272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b6ae7-a8f1-4894-8cd3-06179302e8c3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:47.306280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:47.390247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c298efd-9b41-4da1-ad35-ed2709259752 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:47.390973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b6ae7-a8f1-4894-8cd3-06179302e8c3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:47.425831 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010282d9-0f64-47e1-a9c4-158a48793fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:47.426452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010282d9-0f64-47e1-a9c4-158a48793fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.426829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010282d9-0f64-47e1-a9c4-158a48793fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.427108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010282d9-0f64-47e1-a9c4-158a48793fa6 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.427218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf63121-f474-4d6f-9981-f50a39ddd376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:47.427767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010282d9-0f64-47e1-a9c4-158a48793fa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:47.427864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63121-f474-4d6f-9981-f50a39ddd376 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.428144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63121-f474-4d6f-9981-f50a39ddd376 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.428417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf63121-f474-4d6f-9981-f50a39ddd376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.429215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010282d9-0f64-47e1-a9c4-158a48793fa6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:47.429327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63121-f474-4d6f-9981-f50a39ddd376 None admin] RBAC: Adding query filter params (role.id=4063288b76d14443b6b9f188c7d8dfd6, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=36f4189de0674590a257d9de7a60c63f) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:47.429554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63121-f474-4d6f-9981-f50a39ddd376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:47.430955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf63121-f474-4d6f-9981-f50a39ddd376 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:47.436256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 491/995] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 28 17:48:47 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:48:47.445272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 505/996] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:47 2022] GET /identity/v3/role_assignments?user.id=36f4189de0674590a257d9de7a60c63f&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=4063288b76d14443b6b9f188c7d8dfd6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:47.799170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f6ff-a34b-4dda-9529-4352108026f5 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.799500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f6ff-a34b-4dda-9529-4352108026f5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.799738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0f6ff-a34b-4dda-9529-4352108026f5 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.801399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 492/997] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:47.814100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a074e-4b94-4903-bd32-3733fa2ce77d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:47.814589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a074e-4b94-4903-bd32-3733fa2ce77d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:47.814668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a074e-4b94-4903-bd32-3733fa2ce77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:47.832376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-034a074e-4b94-4903-bd32-3733fa2ce77d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:47.833572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-034a074e-4b94-4903-bd32-3733fa2ce77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:47.904844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 506/998] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:47.926332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f6ff-a34b-4dda-9529-4352108026f5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:47.959010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:48.047699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0f6ff-a34b-4dda-9529-4352108026f5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:48.081311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738cb05-0ffe-4be9-823a-3e0880b45b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:48.081866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cb05-0ffe-4be9-823a-3e0880b45b4d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:48.082142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cb05-0ffe-4be9-823a-3e0880b45b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:48.082412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738cb05-0ffe-4be9-823a-3e0880b45b4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:48.083098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738cb05-0ffe-4be9-823a-3e0880b45b4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:48.084498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738cb05-0ffe-4be9-823a-3e0880b45b4d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8738cb05-0ffe-4be9-823a-3e0880b45b4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:48.095810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:48.096841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 17:48:48.097698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:48.099088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 493/999] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 28 17:48:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:48.103571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a074e-4b94-4903-bd32-3733fa2ce77d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:48.118643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:48.212745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a074e-4b94-4903-bd32-3733fa2ce77d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:48.261744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5227ab-4e72-4616-8319-3bf9b5ad6325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:48.262380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5227ab-4e72-4616-8319-3bf9b5ad6325 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:48.262657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5227ab-4e72-4616-8319-3bf9b5ad6325 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:48.263102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5227ab-4e72-4616-8319-3bf9b5ad6325 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:48.263850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5227ab-4e72-4616-8319-3bf9b5ad6325 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:48.264158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5227ab-4e72-4616-8319-3bf9b5ad6325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:48.266015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5227ab-4e72-4616-8319-3bf9b5ad6325 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:48.279483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 507/1000] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:48.281071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738cb05-0ffe-4be9-823a-3e0880b45b4d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:48.380367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:48.389814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738cb05-0ffe-4be9-823a-3e0880b45b4d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:48.424030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03115f-1527-4a6c-b6c3-bb54503a6b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:48.424650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03115f-1527-4a6c-b6c3-bb54503a6b0a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:48.424959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03115f-1527-4a6c-b6c3-bb54503a6b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:48.425235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03115f-1527-4a6c-b6c3-bb54503a6b0a None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:48.425908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03115f-1527-4a6c-b6c3-bb54503a6b0a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:48.426211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03115f-1527-4a6c-b6c3-bb54503a6b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:48.427568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03115f-1527-4a6c-b6c3-bb54503a6b0a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:48.437651 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 494/1001] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 28 17:48:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:48.439110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5227ab-4e72-4616-8319-3bf9b5ad6325 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:48.518037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:48.541254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5227ab-4e72-4616-8319-3bf9b5ad6325 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:48.576650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c3725-be6a-4dcb-b5e9-1d1570d33e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:48.577310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c3725-be6a-4dcb-b5e9-1d1570d33e1d None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:48.577591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c3725-be6a-4dcb-b5e9-1d1570d33e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:48.577869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c3725-be6a-4dcb-b5e9-1d1570d33e1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:48.578669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c3725-be6a-4dcb-b5e9-1d1570d33e1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:48.580573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c3725-be6a-4dcb-b5e9-1d1570d33e1d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:48.660149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 508/1002] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 17:48:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:49.478200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212272b-4532-45de-9a4c-d3ea997098ea None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.478691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212272b-4532-45de-9a4c-d3ea997098ea None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.478691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212272b-4532-45de-9a4c-d3ea997098ea None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.480187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 495/1003] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:49.485527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33193-7dc2-4ef2-8eb3-e7676f29c209 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.485907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33193-7dc2-4ef2-8eb3-e7676f29c209 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.486084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33193-7dc2-4ef2-8eb3-e7676f29c209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.503977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2bf33193-7dc2-4ef2-8eb3-e7676f29c209 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:49.505166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2bf33193-7dc2-4ef2-8eb3-e7676f29c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:49.547213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf9e95-445b-4ee8-851d-10a32d498065 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.548010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf9e95-445b-4ee8-851d-10a32d498065 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.548281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf9e95-445b-4ee8-851d-10a32d498065 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.549782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 496/1004] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:49.555513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb864950-e3b8-4d2b-849a-f8830fbcdf8f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.555997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb864950-e3b8-4d2b-849a-f8830fbcdf8f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.556513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb864950-e3b8-4d2b-849a-f8830fbcdf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.575350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-eb864950-e3b8-4d2b-849a-f8830fbcdf8f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:49.576849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-eb864950-e3b8-4d2b-849a-f8830fbcdf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:49.582817 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 509/1005] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:49.605270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33193-7dc2-4ef2-8eb3-e7676f29c209 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:49.650169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 497/1006] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:49.669142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:49.671929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb864950-e3b8-4d2b-849a-f8830fbcdf8f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:49.712171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33193-7dc2-4ef2-8eb3-e7676f29c209 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:49.747309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a27a5-be77-47ea-86ca-acc8882f2fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:49.748245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a27a5-be77-47ea-86ca-acc8882f2fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.748710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a27a5-be77-47ea-86ca-acc8882f2fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.749011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a27a5-be77-47ea-86ca-acc8882f2fa8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.749642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a27a5-be77-47ea-86ca-acc8882f2fa8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:49.751541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a27a5-be77-47ea-86ca-acc8882f2fa8 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-1b2a27a5-be77-47ea-86ca-acc8882f2fa8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:49.760946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:49.762022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:49.762958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 510/1007] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:49.768228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:49.769137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a27a5-be77-47ea-86ca-acc8882f2fa8 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:49.787177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb864950-e3b8-4d2b-849a-f8830fbcdf8f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:49.821770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a746dea-56e2-4f6b-a9d6-ea891511d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:49.822404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a746dea-56e2-4f6b-a9d6-ea891511d88c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.822673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a746dea-56e2-4f6b-a9d6-ea891511d88c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.822934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a746dea-56e2-4f6b-a9d6-ea891511d88c None admin] PATH_INFO: `/v3/services/image` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.823545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a746dea-56e2-4f6b-a9d6-ea891511d88c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:49.826160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a746dea-56e2-4f6b-a9d6-ea891511d88c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7a746dea-56e2-4f6b-a9d6-ea891511d88c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:49.839130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:49.840389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:48:49.841574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:49.843753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 498/1008] 10.222.0.67 () {56 vars in 1105 bytes} [Thu Jul 28 17:48:49 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:49.850084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a746dea-56e2-4f6b-a9d6-ea891511d88c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:49.885830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a27a5-be77-47ea-86ca-acc8882f2fa8 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:49.914014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:49.923884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b6a41-197b-424d-b0f5-bbd40507125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:49.924494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b6a41-197b-424d-b0f5-bbd40507125d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.924770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b6a41-197b-424d-b0f5-bbd40507125d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.925063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b6a41-197b-424d-b0f5-bbd40507125d None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.933254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b6a41-197b-424d-b0f5-bbd40507125d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:49.933254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b6a41-197b-424d-b0f5-bbd40507125d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:49.933254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b6a41-197b-424d-b0f5-bbd40507125d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:49.933254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 511/1009] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:49.938496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b6a41-197b-424d-b0f5-bbd40507125d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:49.958388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a746dea-56e2-4f6b-a9d6-ea891511d88c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:49.997983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8f60e-fb92-4a9a-a37e-94066d814da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:49.998571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8f60e-fb92-4a9a-a37e-94066d814da3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:49.998851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8f60e-fb92-4a9a-a37e-94066d814da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:49.999116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8f60e-fb92-4a9a-a37e-94066d814da3 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:49.999782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8f60e-fb92-4a9a-a37e-94066d814da3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:50.000082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8f60e-fb92-4a9a-a37e-94066d814da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.001996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8f60e-fb92-4a9a-a37e-94066d814da3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.007123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 499/1010] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:50.012726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8f60e-fb92-4a9a-a37e-94066d814da3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:50.031018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:50.051330 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b6a41-197b-424d-b0f5-bbd40507125d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:50.097039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4367-b30b-47f0-9647-3113cdd028d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:50.098099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4367-b30b-47f0-9647-3113cdd028d7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.098380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4367-b30b-47f0-9647-3113cdd028d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.098653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4367-b30b-47f0-9647-3113cdd028d7 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.099336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c4367-b30b-47f0-9647-3113cdd028d7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:50.099640 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c4367-b30b-47f0-9647-3113cdd028d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.101417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c4367-b30b-47f0-9647-3113cdd028d7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.107264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 512/1011] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 28 17:48:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:50.113767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4367-b30b-47f0-9647-3113cdd028d7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:50.130074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8f60e-fb92-4a9a-a37e-94066d814da3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:50.171979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa5401-8e9d-4318-8a9c-d40c6062d528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:50.173073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa5401-8e9d-4318-8a9c-d40c6062d528 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.173356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa5401-8e9d-4318-8a9c-d40c6062d528 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.173740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa5401-8e9d-4318-8a9c-d40c6062d528 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.174409 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa5401-8e9d-4318-8a9c-d40c6062d528 None admin] RBAC: Adding query filter params (type=image) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:50.174722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa5401-8e9d-4318-8a9c-d40c6062d528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.176110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa5401-8e9d-4318-8a9c-d40c6062d528 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.181072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 500/1012] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:50.181274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:50.236385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4367-b30b-47f0-9647-3113cdd028d7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:50.274480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0c61b-432e-4ced-9f35-8539846ad9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:50.275023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0c61b-432e-4ced-9f35-8539846ad9c0 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.275302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0c61b-432e-4ced-9f35-8539846ad9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.275572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0c61b-432e-4ced-9f35-8539846ad9c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.276285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0c61b-432e-4ced-9f35-8539846ad9c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.277709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0c61b-432e-4ced-9f35-8539846ad9c0 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.397281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 513/1013] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 17:48:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:50.683288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0e3d3-ffa0-496e-b8d3-b0dbd5ba04e4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.683841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0e3d3-ffa0-496e-b8d3-b0dbd5ba04e4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.683841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0e3d3-ffa0-496e-b8d3-b0dbd5ba04e4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.685256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 501/1014] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:50.691105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b5ae-6dc9-4fe8-bd0a-5980b1f86786 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.691510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b5ae-6dc9-4fe8-bd0a-5980b1f86786 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.691687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b5ae-6dc9-4fe8-bd0a-5980b1f86786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.710153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-d298b5ae-6dc9-4fe8-bd0a-5980b1f86786 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:50.711333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d298b5ae-6dc9-4fe8-bd0a-5980b1f86786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:50.783482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 514/1015] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:50 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:50.806081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0e3d3-ffa0-496e-b8d3-b0dbd5ba04e4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:50.884042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:50.907626 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0e3d3-ffa0-496e-b8d3-b0dbd5ba04e4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:50.942078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18848b-d8be-4443-8142-11655ec467fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:50.942703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18848b-d8be-4443-8142-11655ec467fa None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:50.942988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18848b-d8be-4443-8142-11655ec467fa None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:50.943257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18848b-d8be-4443-8142-11655ec467fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:50.944448 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18848b-d8be-4443-8142-11655ec467fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:50.945915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18848b-d8be-4443-8142-11655ec467fa None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:50.947728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 502/1016] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:50.953336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298b5ae-6dc9-4fe8-bd0a-5980b1f86786 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:50.988424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:51.055177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298b5ae-6dc9-4fe8-bd0a-5980b1f86786 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:51.090644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bd0de-b4c6-4ca0-90db-e3b88f899299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:51.091444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bd0de-b4c6-4ca0-90db-e3b88f899299 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:51.091874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bd0de-b4c6-4ca0-90db-e3b88f899299 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:51.092319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bd0de-b4c6-4ca0-90db-e3b88f899299 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:51.093193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bd0de-b4c6-4ca0-90db-e3b88f899299 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:51.095452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bd0de-b4c6-4ca0-90db-e3b88f899299 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:51.261105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 515/1017] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:48:50 2022] POST /identity/v3/projects => generated 311 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:52.242382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efe533-7ca4-42b9-9694-5a38a0cede8b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.242920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efe533-7ca4-42b9-9694-5a38a0cede8b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.242920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efe533-7ca4-42b9-9694-5a38a0cede8b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.244285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 503/1018] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:52.249751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8b34-5869-45b6-a162-41cb4d3ae593 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.250153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8b34-5869-45b6-a162-41cb4d3ae593 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.250312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8b34-5869-45b6-a162-41cb4d3ae593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.268472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-376d8b34-5869-45b6-a162-41cb4d3ae593 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:52.269707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-376d8b34-5869-45b6-a162-41cb4d3ae593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:52.338509 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 516/1019] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:52.362058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efe533-7ca4-42b9-9694-5a38a0cede8b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:52.469221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efe533-7ca4-42b9-9694-5a38a0cede8b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:52.502825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5afb-ae52-47de-80a1-8a6ff5b36f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:52.503441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5afb-ae52-47de-80a1-8a6ff5b36f5b None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.503723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5afb-ae52-47de-80a1-8a6ff5b36f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.503998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5afb-ae52-47de-80a1-8a6ff5b36f5b None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.504685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b5afb-ae52-47de-80a1-8a6ff5b36f5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:52.506084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b5afb-ae52-47de-80a1-8a6ff5b36f5b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:52.539355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e42bc-91bf-4aed-94f2-0fb38a140bca None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.539635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e42bc-91bf-4aed-94f2-0fb38a140bca None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.539910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e42bc-91bf-4aed-94f2-0fb38a140bca None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.541335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 517/1020] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:52.546349 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620cfde-3c72-4bba-9e3a-6cc182ac403c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.546639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620cfde-3c72-4bba-9e3a-6cc182ac403c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.546914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620cfde-3c72-4bba-9e3a-6cc182ac403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.564735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b620cfde-3c72-4bba-9e3a-6cc182ac403c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:52.565947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b620cfde-3c72-4bba-9e3a-6cc182ac403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:52.579378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:52.598421 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 504/1021] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:48:52 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:48:52.644720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 518/1022] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:52.668343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5afb-ae52-47de-80a1-8a6ff5b36f5b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:52.672490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:52.786157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5afb-ae52-47de-80a1-8a6ff5b36f5b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:52.821152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d0383-5824-4894-89c9-bc7491deea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:52.821796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d0383-5824-4894-89c9-bc7491deea99 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.822077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d0383-5824-4894-89c9-bc7491deea99 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.822350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d0383-5824-4894-89c9-bc7491deea99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.833263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d0383-5824-4894-89c9-bc7491deea99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-589d0383-5824-4894-89c9-bc7491deea99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:52.838704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:52.839649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:52.840524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 505/1023] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 28 17:48:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:52.846169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620cfde-3c72-4bba-9e3a-6cc182ac403c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:52.946042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620cfde-3c72-4bba-9e3a-6cc182ac403c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:52.981090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f0c15-8076-42ce-afa6-2fad4ea20a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:52.981711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0c15-8076-42ce-afa6-2fad4ea20a87 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:52.981990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0c15-8076-42ce-afa6-2fad4ea20a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:52.982259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0c15-8076-42ce-afa6-2fad4ea20a87 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:52.982972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f0c15-8076-42ce-afa6-2fad4ea20a87 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:52.983274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f0c15-8076-42ce-afa6-2fad4ea20a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:52.984633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f0c15-8076-42ce-afa6-2fad4ea20a87 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:52.997611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 519/1024] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 28 17:48:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:52.998889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d0383-5824-4894-89c9-bc7491deea99 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.067073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.109032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d0383-5824-4894-89c9-bc7491deea99 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.143152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aae893-303e-4c99-a264-eb1cba7368db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.143793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aae893-303e-4c99-a264-eb1cba7368db None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.144070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aae893-303e-4c99-a264-eb1cba7368db None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.144376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aae893-303e-4c99-a264-eb1cba7368db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.155326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aae893-303e-4c99-a264-eb1cba7368db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:53.156813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aae893-303e-4c99-a264-eb1cba7368db None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e0aae893-303e-4c99-a264-eb1cba7368db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:53.173491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:53.174395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:53.175401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:53.175401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:53.175401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:53.175401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:53.175401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 506/1025] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:53.181482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f0c15-8076-42ce-afa6-2fad4ea20a87 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.191701 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.285162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f0c15-8076-42ce-afa6-2fad4ea20a87 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.294001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95101-fb2b-4cb8-bb1e-f33fe564e995 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.294465 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95101-fb2b-4cb8-bb1e-f33fe564e995 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.294558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95101-fb2b-4cb8-bb1e-f33fe564e995 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.296128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 507/1026] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:53.301569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29defd-56bf-4bba-8114-a22b0cd761f5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.301866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29defd-56bf-4bba-8114-a22b0cd761f5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.302123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29defd-56bf-4bba-8114-a22b0cd761f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.320082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9e29defd-56bf-4bba-8114-a22b0cd761f5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:53.321203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9e29defd-56bf-4bba-8114-a22b0cd761f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:53.322351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513651a-543f-405d-84f6-babe9f131aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.322967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513651a-543f-405d-84f6-babe9f131aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.323250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513651a-543f-405d-84f6-babe9f131aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.323516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513651a-543f-405d-84f6-babe9f131aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.324204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513651a-543f-405d-84f6-babe9f131aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:53.324504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513651a-543f-405d-84f6-babe9f131aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:53.325905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513651a-543f-405d-84f6-babe9f131aa7 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:53.338423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 520/1027] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:53.343945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513651a-543f-405d-84f6-babe9f131aa7 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.398110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 508/1028] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:53.409800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.421614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29defd-56bf-4bba-8114-a22b0cd761f5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.443928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513651a-543f-405d-84f6-babe9f131aa7 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.468476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.484459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7417-f46b-4fdc-91b4-d2e14b2ed295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.485154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7417-f46b-4fdc-91b4-d2e14b2ed295 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.485433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7417-f46b-4fdc-91b4-d2e14b2ed295 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.485726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7417-f46b-4fdc-91b4-d2e14b2ed295 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.492899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa7417-f46b-4fdc-91b4-d2e14b2ed295 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:53.494339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa7417-f46b-4fdc-91b4-d2e14b2ed295 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-3cfa7417-f46b-4fdc-91b4-d2e14b2ed295 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:53.506496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:53.507451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:53.508385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 521/1029] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 28 17:48:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:53.513230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7417-f46b-4fdc-91b4-d2e14b2ed295 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.530710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29defd-56bf-4bba-8114-a22b0cd761f5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.566228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332fcc7-adca-4557-9e6d-7c518f05c243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.566814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332fcc7-adca-4557-9e6d-7c518f05c243 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.567098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332fcc7-adca-4557-9e6d-7c518f05c243 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.567370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332fcc7-adca-4557-9e6d-7c518f05c243 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.568527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332fcc7-adca-4557-9e6d-7c518f05c243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:53.569988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332fcc7-adca-4557-9e6d-7c518f05c243 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:53.571977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 509/1030] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:53.577492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332fcc7-adca-4557-9e6d-7c518f05c243 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.616622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7417-f46b-4fdc-91b4-d2e14b2ed295 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.641847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.650561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abe9b4-90f2-44c5-b92f-38b9f8b1c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.651180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abe9b4-90f2-44c5-b92f-38b9f8b1c923 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.651459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abe9b4-90f2-44c5-b92f-38b9f8b1c923 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.651732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abe9b4-90f2-44c5-b92f-38b9f8b1c923 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.652579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abe9b4-90f2-44c5-b92f-38b9f8b1c923 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:53.652917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abe9b4-90f2-44c5-b92f-38b9f8b1c923 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:53.654347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abe9b4-90f2-44c5-b92f-38b9f8b1c923 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:53.672251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 522/1031] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 28 17:48:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:53.677642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abe9b4-90f2-44c5-b92f-38b9f8b1c923 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:53.689984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332fcc7-adca-4557-9e6d-7c518f05c243 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.704415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.726369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9f323-0697-4dd7-bd45-884d9b5e71bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.727330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9f323-0697-4dd7-bd45-884d9b5e71bc None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.727614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9f323-0697-4dd7-bd45-884d9b5e71bc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.727887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9f323-0697-4dd7-bd45-884d9b5e71bc None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.728597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9f323-0697-4dd7-bd45-884d9b5e71bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:53.730126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9f323-0697-4dd7-bd45-884d9b5e71bc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:53.793126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abe9b4-90f2-44c5-b92f-38b9f8b1c923 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:53.827396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f0c5-b834-4a7f-ba13-982180a09b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:53.827943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f0c5-b834-4a7f-ba13-982180a09b55 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:53.828225 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f0c5-b834-4a7f-ba13-982180a09b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:53.828500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f0c5-b834-4a7f-ba13-982180a09b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:53.860825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 510/1032] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:48:53 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:53.894943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:53.913667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70f0c5-b834-4a7f-ba13-982180a09b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:53.915149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70f0c5-b834-4a7f-ba13-982180a09b55 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:54.024227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 523/1033] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:48:54.033146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9f323-0697-4dd7-bd45-884d9b5e71bc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:54.144239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9f323-0697-4dd7-bd45-884d9b5e71bc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:54.182603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9099f8a-e24d-4136-980d-c4d4953e3eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:54.183249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9099f8a-e24d-4136-980d-c4d4953e3eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:54.183520 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9099f8a-e24d-4136-980d-c4d4953e3eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:54.183787 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9099f8a-e24d-4136-980d-c4d4953e3eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:54.195309 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9099f8a-e24d-4136-980d-c4d4953e3eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:54.196739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9099f8a-e24d-4136-980d-c4d4953e3eb6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b9099f8a-e24d-4136-980d-c4d4953e3eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:54.211236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:54.212196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:54.213794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:54.213794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:54.213794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:54.213794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:54.213794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 511/1034] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:54.218251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f0c5-b834-4a7f-ba13-982180a09b55 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:54.302029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:54.319145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f0c5-b834-4a7f-ba13-982180a09b55 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:54.353903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e17d1-ccfc-4c9f-89e6-671ea29ce67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:54.354512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e17d1-ccfc-4c9f-89e6-671ea29ce67d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:54.354784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e17d1-ccfc-4c9f-89e6-671ea29ce67d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:54.355049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e17d1-ccfc-4c9f-89e6-671ea29ce67d None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:54.355727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e17d1-ccfc-4c9f-89e6-671ea29ce67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:54.356025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e17d1-ccfc-4c9f-89e6-671ea29ce67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:54.357407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e17d1-ccfc-4c9f-89e6-671ea29ce67d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:54.370260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 524/1035] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:54.374663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9099f8a-e24d-4136-980d-c4d4953e3eb6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:54.400641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:54.473877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9099f8a-e24d-4136-980d-c4d4953e3eb6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:54.507484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3accbf7-8f68-4389-b7cd-0f7fee2c99de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:54.508118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3accbf7-8f68-4389-b7cd-0f7fee2c99de None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:54.508395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3accbf7-8f68-4389-b7cd-0f7fee2c99de None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:54.508663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3accbf7-8f68-4389-b7cd-0f7fee2c99de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:54.515223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3accbf7-8f68-4389-b7cd-0f7fee2c99de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:54.517226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3accbf7-8f68-4389-b7cd-0f7fee2c99de None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a3accbf7-8f68-4389-b7cd-0f7fee2c99de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:54.528265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:54.529186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:54.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:54.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:54.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:54.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:54.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:54.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:54.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:54.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:54.533152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 512/1036] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:54.535148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e17d1-ccfc-4c9f-89e6-671ea29ce67d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:54.635841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e17d1-ccfc-4c9f-89e6-671ea29ce67d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:54.645357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8452b17-2fec-47d7-a172-42be6ef1c215 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:54.645647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8452b17-2fec-47d7-a172-42be6ef1c215 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:54.645923 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8452b17-2fec-47d7-a172-42be6ef1c215 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:54.647279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 513/1037] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:54.652150 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559225ac-7293-43af-b361-d6ebc2faea69 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:54.652330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559225ac-7293-43af-b361-d6ebc2faea69 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:54.652571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559225ac-7293-43af-b361-d6ebc2faea69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:54.670738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-559225ac-7293-43af-b361-d6ebc2faea69 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:54.671925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-559225ac-7293-43af-b361-d6ebc2faea69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:54.672775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87851dea-30a1-4213-a6b2-4c80df4f6b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:54.673426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87851dea-30a1-4213-a6b2-4c80df4f6b1d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:54.673704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87851dea-30a1-4213-a6b2-4c80df4f6b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:54.673970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87851dea-30a1-4213-a6b2-4c80df4f6b1d None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:54.674711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87851dea-30a1-4213-a6b2-4c80df4f6b1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:54.675012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87851dea-30a1-4213-a6b2-4c80df4f6b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:54.676426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87851dea-30a1-4213-a6b2-4c80df4f6b1d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:54.689554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 525/1038] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:54.695189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87851dea-30a1-4213-a6b2-4c80df4f6b1d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:54.698885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:54.743039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 514/1039] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:54.765055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559225ac-7293-43af-b361-d6ebc2faea69 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:54.779721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:54.803000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87851dea-30a1-4213-a6b2-4c80df4f6b1d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:54.839031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f2301-a107-47c0-a1f7-f1faa3adfd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:54.839630 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f2301-a107-47c0-a1f7-f1faa3adfd01 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:54.839905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f2301-a107-47c0-a1f7-f1faa3adfd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:54.840173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f2301-a107-47c0-a1f7-f1faa3adfd01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:54.840992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f2301-a107-47c0-a1f7-f1faa3adfd01 None admin] RBAC: Adding query filter params (role.id=4063288b76d14443b6b9f188c7d8dfd6, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=cb85b3e1dc464438ac007c1b09ea7fd3) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:54.841299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f2301-a107-47c0-a1f7-f1faa3adfd01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:54.842719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f2301-a107-47c0-a1f7-f1faa3adfd01 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:54.848108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 526/1040] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:54 2022] GET /identity/v3/role_assignments?user.id=cb85b3e1dc464438ac007c1b09ea7fd3&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=4063288b76d14443b6b9f188c7d8dfd6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:54.873542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559225ac-7293-43af-b361-d6ebc2faea69 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:54.911018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ebd1-5889-4a28-b87f-567e83fecaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:54.911603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ebd1-5889-4a28-b87f-567e83fecaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:54.911883 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ebd1-5889-4a28-b87f-567e83fecaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:54.912156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ebd1-5889-4a28-b87f-567e83fecaa6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:54.912820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ebd1-5889-4a28-b87f-567e83fecaa6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:54.914200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ebd1-5889-4a28-b87f-567e83fecaa6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0843ebd1-5889-4a28-b87f-567e83fecaa6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:54.923885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:54.925015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:54.930918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 515/1041] 10.222.0.67 () {56 vars in 1105 bytes} [Thu Jul 28 17:48:54 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:54.931736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f2301-a107-47c0-a1f7-f1faa3adfd01 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:55.007886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:55.051289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f2301-a107-47c0-a1f7-f1faa3adfd01 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:55.085209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaa53a-5c63-4241-8147-c731044f1d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:55.085827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaa53a-5c63-4241-8147-c731044f1d29 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:55.086102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaa53a-5c63-4241-8147-c731044f1d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:55.086372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaa53a-5c63-4241-8147-c731044f1d29 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:55.087035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaa53a-5c63-4241-8147-c731044f1d29 None admin] RBAC: Adding query filter params (name=image) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:55.087334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaa53a-5c63-4241-8147-c731044f1d29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:55.088717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaa53a-5c63-4241-8147-c731044f1d29 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:55.098693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 527/1042] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:55.099751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ebd1-5889-4a28-b87f-567e83fecaa6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:55.187080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:55.210305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ebd1-5889-4a28-b87f-567e83fecaa6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:55.244446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03e1cf-422b-4f3e-b80b-2331de6b0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:55.245090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03e1cf-422b-4f3e-b80b-2331de6b0c3e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:55.245375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03e1cf-422b-4f3e-b80b-2331de6b0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:55.245646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03e1cf-422b-4f3e-b80b-2331de6b0c3e None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:55.246316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03e1cf-422b-4f3e-b80b-2331de6b0c3e None admin] RBAC: Adding query filter params (type=image) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:55.246617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03e1cf-422b-4f3e-b80b-2331de6b0c3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:55.247970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03e1cf-422b-4f3e-b80b-2331de6b0c3e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:55.253003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 516/1043] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:55.258667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaa53a-5c63-4241-8147-c731044f1d29 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:55.366233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaa53a-5c63-4241-8147-c731044f1d29 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:55.395631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:55.401017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fe33d-0d9f-4dbf-a0ff-c77bcba7d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:55.401634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fe33d-0d9f-4dbf-a0ff-c77bcba7d70d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:55.401918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fe33d-0d9f-4dbf-a0ff-c77bcba7d70d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:55.402208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fe33d-0d9f-4dbf-a0ff-c77bcba7d70d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:55.402943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fe33d-0d9f-4dbf-a0ff-c77bcba7d70d None admin] RBAC: Adding query filter params (interface=public, service_id=201a505f98674d5f8593d98579c1b020, region_id=RegionOne) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:55.403251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fe33d-0d9f-4dbf-a0ff-c77bcba7d70d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:55.404607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fe33d-0d9f-4dbf-a0ff-c77bcba7d70d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:55.415012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 528/1044] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 28 17:48:55 2022] GET /identity/v3/endpoints?service_id=201a505f98674d5f8593d98579c1b020&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:55.415919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03e1cf-422b-4f3e-b80b-2331de6b0c3e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:55.518467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03e1cf-422b-4f3e-b80b-2331de6b0c3e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:55.552758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e402d-e7c5-47e8-ad33-cc8077f22149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:55.553408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e402d-e7c5-47e8-ad33-cc8077f22149 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:55.553737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e402d-e7c5-47e8-ad33-cc8077f22149 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:55.554017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e402d-e7c5-47e8-ad33-cc8077f22149 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:55.554656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e402d-e7c5-47e8-ad33-cc8077f22149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:55.556025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e402d-e7c5-47e8-ad33-cc8077f22149 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:55.568815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 517/1045] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 28 17:48:55 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 17:48:55.934439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d9d4e-2b14-4c76-85b5-f9b529ebbcef None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:55.934826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d9d4e-2b14-4c76-85b5-f9b529ebbcef None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:55.935006 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d9d4e-2b14-4c76-85b5-f9b529ebbcef None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:55.936642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 529/1046] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:55.942955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166dbf-5921-4dde-a8c4-96125f0ced84 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:55.943263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166dbf-5921-4dde-a8c4-96125f0ced84 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:55.943503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166dbf-5921-4dde-a8c4-96125f0ced84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:55.950932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:55.962339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-67166dbf-5921-4dde-a8c4-96125f0ced84 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:55.963657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-67166dbf-5921-4dde-a8c4-96125f0ced84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:56.034039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 518/1047] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:56.055859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d9d4e-2b14-4c76-85b5-f9b529ebbcef None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:56.165858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d9d4e-2b14-4c76-85b5-f9b529ebbcef None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:56.209386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020700b6-588d-482a-a185-3e148b0090d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:56.209953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020700b6-588d-482a-a185-3e148b0090d6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:56.210230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020700b6-588d-482a-a185-3e148b0090d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:56.210501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020700b6-588d-482a-a185-3e148b0090d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:56.221632 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020700b6-588d-482a-a185-3e148b0090d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-020700b6-588d-482a-a185-3e148b0090d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:56.226528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:56.227450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:56.233524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 530/1048] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:56.234286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67166dbf-5921-4dde-a8c4-96125f0ced84 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:56.337369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67166dbf-5921-4dde-a8c4-96125f0ced84 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:56.372082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c67bb4-e50f-443e-b427-b637a0afd192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:56.372699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c67bb4-e50f-443e-b427-b637a0afd192 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:56.373002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c67bb4-e50f-443e-b427-b637a0afd192 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:56.373277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c67bb4-e50f-443e-b427-b637a0afd192 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:56.373990 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c67bb4-e50f-443e-b427-b637a0afd192 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:56.374296 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c67bb4-e50f-443e-b427-b637a0afd192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:56.375710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c67bb4-e50f-443e-b427-b637a0afd192 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:56.377149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:56.390412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 519/1049] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:56.393015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020700b6-588d-482a-a185-3e148b0090d6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:56.453015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:56.497730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020700b6-588d-482a-a185-3e148b0090d6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:56.532357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08999a-d45e-4be6-9cf7-a7fdbb4be318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:56.533035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08999a-d45e-4be6-9cf7-a7fdbb4be318 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:56.533369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08999a-d45e-4be6-9cf7-a7fdbb4be318 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:56.533651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08999a-d45e-4be6-9cf7-a7fdbb4be318 None admin] PATH_INFO: `/v3/users/79579ea5541c4655be5a4a01683712d4` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:56.547967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08999a-d45e-4be6-9cf7-a7fdbb4be318 None admin] RBAC: Authorizing `identity:get_user(user_id=79579ea5541c4655be5a4a01683712d4)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:56.549487 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08999a-d45e-4be6-9cf7-a7fdbb4be318 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:56.552940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 531/1050] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:48:56 2022] GET /identity/v3/users/79579ea5541c4655be5a4a01683712d4 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:56.556980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c67bb4-e50f-443e-b427-b637a0afd192 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:56.658489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c67bb4-e50f-443e-b427-b637a0afd192 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:56.694595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d262f1-3a5b-4fef-8b83-5dbdc7747709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:56.695206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d262f1-3a5b-4fef-8b83-5dbdc7747709 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:56.695480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d262f1-3a5b-4fef-8b83-5dbdc7747709 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:56.695746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d262f1-3a5b-4fef-8b83-5dbdc7747709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:56.756250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:56.763272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d262f1-3a5b-4fef-8b83-5dbdc7747709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:56.769420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d262f1-3a5b-4fef-8b83-5dbdc7747709 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:56.850594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be77ab-22dd-474c-bf4b-af5f5d475df6 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:56.850878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be77ab-22dd-474c-bf4b-af5f5d475df6 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:56.851142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be77ab-22dd-474c-bf4b-af5f5d475df6 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:56.852619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 532/1051] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:56.857148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a886ff3-09a9-4e3a-b8f7-537913309286 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:56.857430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a886ff3-09a9-4e3a-b8f7-537913309286 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:56.857703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a886ff3-09a9-4e3a-b8f7-537913309286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:56.867482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 520/1052] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:48:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 17:48:56.868461 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d262f1-3a5b-4fef-8b83-5dbdc7747709 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:56.875459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2a886ff3-09a9-4e3a-b8f7-537913309286 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:56.877194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2a886ff3-09a9-4e3a-b8f7-537913309286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:56.947584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 533/1053] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:56.966351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:56.969728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a886ff3-09a9-4e3a-b8f7-537913309286 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:56.972252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d262f1-3a5b-4fef-8b83-5dbdc7747709 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:57.020847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebddac-17d3-4e21-8dad-97c257b8066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:57.020847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebddac-17d3-4e21-8dad-97c257b8066c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.020847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebddac-17d3-4e21-8dad-97c257b8066c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.020847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebddac-17d3-4e21-8dad-97c257b8066c None admin] PATH_INFO: `/v3/projects/d3905c4f866d475a99441c83a2655605` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.021253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebddac-17d3-4e21-8dad-97c257b8066c None admin] RBAC: Authorizing `identity:get_project(project_id=d3905c4f866d475a99441c83a2655605)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:57.021253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebddac-17d3-4e21-8dad-97c257b8066c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:57.021253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 521/1054] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:48:56 2022] GET /identity/v3/projects/d3905c4f866d475a99441c83a2655605 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:57.021453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:57.021533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebddac-17d3-4e21-8dad-97c257b8066c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:57.074593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a886ff3-09a9-4e3a-b8f7-537913309286 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:57.111378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34909a37-fa98-4bd5-9c75-a07c971a3e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:57.112138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34909a37-fa98-4bd5-9c75-a07c971a3e11 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.112417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34909a37-fa98-4bd5-9c75-a07c971a3e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.112696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34909a37-fa98-4bd5-9c75-a07c971a3e11 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.120603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebddac-17d3-4e21-8dad-97c257b8066c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:57.124544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34909a37-fa98-4bd5-9c75-a07c971a3e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-34909a37-fa98-4bd5-9c75-a07c971a3e11 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:57.129724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:57.130700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:48:57.131712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:57.134019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 534/1055] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 28 17:48:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:57.139503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34909a37-fa98-4bd5-9c75-a07c971a3e11 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:57.159064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6becec3-b340-486a-b04d-8b54b36df126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:57.159678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6becec3-b340-486a-b04d-8b54b36df126 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.159954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6becec3-b340-486a-b04d-8b54b36df126 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.160224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6becec3-b340-486a-b04d-8b54b36df126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.161037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6becec3-b340-486a-b04d-8b54b36df126 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=d3905c4f866d475a99441c83a2655605, user.id=79579ea5541c4655be5a4a01683712d4) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:57.161345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6becec3-b340-486a-b04d-8b54b36df126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:57.162769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6becec3-b340-486a-b04d-8b54b36df126 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:57.171451 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 522/1056] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:48:57 2022] GET /identity/v3/role_assignments?user.id=79579ea5541c4655be5a4a01683712d4&scope.project.id=d3905c4f866d475a99441c83a2655605&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:57.262414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34909a37-fa98-4bd5-9c75-a07c971a3e11 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:57.266257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:57.300592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38a0f7-8d4c-46ab-85dc-0b29ab6f34e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:57.301862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38a0f7-8d4c-46ab-85dc-0b29ab6f34e3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.302140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38a0f7-8d4c-46ab-85dc-0b29ab6f34e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.302414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38a0f7-8d4c-46ab-85dc-0b29ab6f34e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.303145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38a0f7-8d4c-46ab-85dc-0b29ab6f34e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:57.303449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38a0f7-8d4c-46ab-85dc-0b29ab6f34e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:57.304857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38a0f7-8d4c-46ab-85dc-0b29ab6f34e3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:57.318641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 535/1057] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 28 17:48:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:57.320294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6becec3-b340-486a-b04d-8b54b36df126 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:57.356938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:57.432264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6becec3-b340-486a-b04d-8b54b36df126 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:57.466130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d7390-9fbf-4d34-a293-787d112208ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:57.466779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d7390-9fbf-4d34-a293-787d112208ca None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.467058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d7390-9fbf-4d34-a293-787d112208ca None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.467331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d7390-9fbf-4d34-a293-787d112208ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.478576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d7390-9fbf-4d34-a293-787d112208ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:57.480019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d7390-9fbf-4d34-a293-787d112208ca None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-3b2d7390-9fbf-4d34-a293-787d112208ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:57.494554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:57.495477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:57.496366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:57.496366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:57.496366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:57.496366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:57.497203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 523/1058] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:57.501971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38a0f7-8d4c-46ab-85dc-0b29ab6f34e3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:57.597112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17fd8d-a044-416e-afae-afd0a4140462 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.597623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17fd8d-a044-416e-afae-afd0a4140462 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.597623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17fd8d-a044-416e-afae-afd0a4140462 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.599055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 524/1059] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:48:57.603886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8f60-62ec-4548-a2aa-294273a621d7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.604175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8f60-62ec-4548-a2aa-294273a621d7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.604456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8f60-62ec-4548-a2aa-294273a621d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.606259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38a0f7-8d4c-46ab-85dc-0b29ab6f34e3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:57.627331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a7eb8f60-62ec-4548-a2aa-294273a621d7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:57.628623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a7eb8f60-62ec-4548-a2aa-294273a621d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:57.648538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28394b4f-17d4-48d0-b917-0ba7b3e7537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:57.649208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28394b4f-17d4-48d0-b917-0ba7b3e7537a None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.649471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28394b4f-17d4-48d0-b917-0ba7b3e7537a None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.649743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28394b4f-17d4-48d0-b917-0ba7b3e7537a None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.650443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28394b4f-17d4-48d0-b917-0ba7b3e7537a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:57.650747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28394b4f-17d4-48d0-b917-0ba7b3e7537a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:57.652128 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28394b4f-17d4-48d0-b917-0ba7b3e7537a None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:57.669266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 536/1060] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:57.670552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28394b4f-17d4-48d0-b917-0ba7b3e7537a None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:57.701838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:57.713537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 525/1061] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:48:57.736154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb8f60-62ec-4548-a2aa-294273a621d7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:57.747489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:57.775681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28394b4f-17d4-48d0-b917-0ba7b3e7537a None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:57.811209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d8d4-ebfa-43b3-8dab-244a996103e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:57.812225 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d8d4-ebfa-43b3-8dab-244a996103e8 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.812504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d8d4-ebfa-43b3-8dab-244a996103e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.812776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d8d4-ebfa-43b3-8dab-244a996103e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.820489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3d8d4-ebfa-43b3-8dab-244a996103e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:57.822270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3d8d4-ebfa-43b3-8dab-244a996103e8 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-c3e3d8d4-ebfa-43b3-8dab-244a996103e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:48:57.834929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:57.835959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:57.842297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 537/1062] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 28 17:48:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:57.843031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb8f60-62ec-4548-a2aa-294273a621d7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:57.843111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d8d4-ebfa-43b3-8dab-244a996103e8 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:57.879051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e6756-b01f-4c86-a9c2-ff7a897a86af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:57.879737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e6756-b01f-4c86-a9c2-ff7a897a86af None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.880090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e6756-b01f-4c86-a9c2-ff7a897a86af None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.880373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e6756-b01f-4c86-a9c2-ff7a897a86af None admin] PATH_INFO: `/v3/services/image` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.881045 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e6756-b01f-4c86-a9c2-ff7a897a86af None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:57.882417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e6756-b01f-4c86-a9c2-ff7a897a86af None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-559e6756-b01f-4c86-a9c2-ff7a897a86af None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:57.891979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:57.893018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 17:48:57.894053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:57.897937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 526/1063] 10.222.0.67 () {56 vars in 1105 bytes} [Thu Jul 28 17:48:57 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:57.899269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e6756-b01f-4c86-a9c2-ff7a897a86af None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:57.939323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:57.955720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d8d4-ebfa-43b3-8dab-244a996103e8 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:57.982289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:57.990770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e4c59-7f81-41f4-a6b0-66d756db4c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:57.991391 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e4c59-7f81-41f4-a6b0-66d756db4c06 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:57.991674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e4c59-7f81-41f4-a6b0-66d756db4c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:57.991954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e4c59-7f81-41f4-a6b0-66d756db4c06 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:57.992956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e4c59-7f81-41f4-a6b0-66d756db4c06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:57.993282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e4c59-7f81-41f4-a6b0-66d756db4c06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:57.994829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e4c59-7f81-41f4-a6b0-66d756db4c06 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:58.018040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 538/1064] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 28 17:48:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:58.020377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e6756-b01f-4c86-a9c2-ff7a897a86af None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:58.023873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e4c59-7f81-41f4-a6b0-66d756db4c06 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:58.058541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b9b9e-b6b3-45ab-a3d5-e2fdd5662864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:58.059167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b9b9e-b6b3-45ab-a3d5-e2fdd5662864 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.059458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b9b9e-b6b3-45ab-a3d5-e2fdd5662864 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.059779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b9b9e-b6b3-45ab-a3d5-e2fdd5662864 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.060464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b9b9e-b6b3-45ab-a3d5-e2fdd5662864 None admin] RBAC: Adding query filter params (name=image) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:58.060769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b9b9e-b6b3-45ab-a3d5-e2fdd5662864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:58.062404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b9b9e-b6b3-45ab-a3d5-e2fdd5662864 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:58.068068 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 527/1065] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:58.073135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b9b9e-b6b3-45ab-a3d5-e2fdd5662864 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:58.137263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e4c59-7f81-41f4-a6b0-66d756db4c06 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:58.181152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28465-d64c-4ad7-9cd2-8fbbc9942004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:58.181803 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28465-d64c-4ad7-9cd2-8fbbc9942004 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.182200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28465-d64c-4ad7-9cd2-8fbbc9942004 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.182477 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28465-d64c-4ad7-9cd2-8fbbc9942004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.184970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b9b9e-b6b3-45ab-a3d5-e2fdd5662864 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:58.193674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca28465-d64c-4ad7-9cd2-8fbbc9942004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:58.195411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca28465-d64c-4ad7-9cd2-8fbbc9942004 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:58.198466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-eca28465-d64c-4ad7-9cd2-8fbbc9942004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:48:58.215894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:58.216905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:58.217830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:48:58.217830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:48:58.217830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:48:58.217830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:58.217830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 539/1066] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:58.222173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840caa-8e17-491e-8ed0-466560445eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:58.222803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840caa-8e17-491e-8ed0-466560445eae None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.223170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840caa-8e17-491e-8ed0-466560445eae None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.223270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28465-d64c-4ad7-9cd2-8fbbc9942004 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:58.223449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840caa-8e17-491e-8ed0-466560445eae None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.224135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b840caa-8e17-491e-8ed0-466560445eae None admin] RBAC: Adding query filter params (type=image) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:58.224499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b840caa-8e17-491e-8ed0-466560445eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:58.225926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b840caa-8e17-491e-8ed0-466560445eae None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:58.233824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 528/1067] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:48:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:58.238377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840caa-8e17-491e-8ed0-466560445eae None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:58.241216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:58.340030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28465-d64c-4ad7-9cd2-8fbbc9942004 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:58.347356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840caa-8e17-491e-8ed0-466560445eae None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:58.390141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422588c8-0032-496e-ac03-7371a88fb867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:58.390141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422588c8-0032-496e-ac03-7371a88fb867 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.390141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422588c8-0032-496e-ac03-7371a88fb867 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.390141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422588c8-0032-496e-ac03-7371a88fb867 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.390695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422588c8-0032-496e-ac03-7371a88fb867 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:58.392536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422588c8-0032-496e-ac03-7371a88fb867 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:58.396064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c1408-8251-482f-8f2c-1d0ed0b43e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:58.397304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c1408-8251-482f-8f2c-1d0ed0b43e14 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.397809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c1408-8251-482f-8f2c-1d0ed0b43e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.398168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c1408-8251-482f-8f2c-1d0ed0b43e14 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.398911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c1408-8251-482f-8f2c-1d0ed0b43e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:58.399264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c1408-8251-482f-8f2c-1d0ed0b43e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:58.400952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c1408-8251-482f-8f2c-1d0ed0b43e14 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:58.414940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 540/1068] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:58.420366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c1408-8251-482f-8f2c-1d0ed0b43e14 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:58.475742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:58.515845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c1408-8251-482f-8f2c-1d0ed0b43e14 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:58.550027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd2f6e-0e4b-4ba5-875c-ed5b2eb7a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:58.560667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd2f6e-0e4b-4ba5-875c-ed5b2eb7a0ec None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.560667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd2f6e-0e4b-4ba5-875c-ed5b2eb7a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.560667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd2f6e-0e4b-4ba5-875c-ed5b2eb7a0ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.561027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 529/1069] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 17:48:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:48:58.569150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd2f6e-0e4b-4ba5-875c-ed5b2eb7a0ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:58.570711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd2f6e-0e4b-4ba5-875c-ed5b2eb7a0ec None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-38fd2f6e-0e4b-4ba5-875c-ed5b2eb7a0ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:48:58.583597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:58.584672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:58.585726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:48:58.585726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:48:58.585726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:48:58.585726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:48:58.585726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:48:58.585726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:48:58.585726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:48:58.585726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:48:58.585726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 541/1070] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:48:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:48:58.590667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422588c8-0032-496e-ac03-7371a88fb867 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:58.655990 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:58.709326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422588c8-0032-496e-ac03-7371a88fb867 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:58.748934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a0138-83b2-4af3-b663-6771c61ce5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:58.749568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a0138-83b2-4af3-b663-6771c61ce5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.749850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a0138-83b2-4af3-b663-6771c61ce5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.750120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a0138-83b2-4af3-b663-6771c61ce5d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.751430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a0138-83b2-4af3-b663-6771c61ce5d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:58.751740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a0138-83b2-4af3-b663-6771c61ce5d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:58.753320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a0138-83b2-4af3-b663-6771c61ce5d9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:58.769774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 530/1071] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:48:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:58.776009 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd2f6e-0e4b-4ba5-875c-ed5b2eb7a0ec None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:58.878951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd2f6e-0e4b-4ba5-875c-ed5b2eb7a0ec None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:58.895489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:58.916934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f523cde-2e3f-43d9-ac36-fdd6d0d80be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:58.916934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f523cde-2e3f-43d9-ac36-fdd6d0d80be3 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:58.916934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f523cde-2e3f-43d9-ac36-fdd6d0d80be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:58.916934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f523cde-2e3f-43d9-ac36-fdd6d0d80be3 None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/cb85b3e1dc464438ac007c1b09ea7fd3/roles/4063288b76d14443b6b9f188c7d8dfd6` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:58.917354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f523cde-2e3f-43d9-ac36-fdd6d0d80be3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=cb85b3e1dc464438ac007c1b09ea7fd3, role_id=4063288b76d14443b6b9f188c7d8dfd6)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:58.918545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f523cde-2e3f-43d9-ac36-fdd6d0d80be3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:59.008083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 542/1072] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:58 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/cb85b3e1dc464438ac007c1b09ea7fd3/roles/4063288b76d14443b6b9f188c7d8dfd6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:48:59.183761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b090de-d071-42c2-8d8f-b61c6817070f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:59.184048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b090de-d071-42c2-8d8f-b61c6817070f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:59.184322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b090de-d071-42c2-8d8f-b61c6817070f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:59.185862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 531/1073] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:48:59.191807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59b1a-65c1-410e-837e-5d2ed4302e82 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:59.192098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59b1a-65c1-410e-837e-5d2ed4302e82 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:59.192373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59b1a-65c1-410e-837e-5d2ed4302e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:59.210645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ffa59b1a-65c1-410e-837e-5d2ed4302e82 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:48:59.211825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ffa59b1a-65c1-410e-837e-5d2ed4302e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:48:59.281650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 543/1074] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:48:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:48:59.304081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b090de-d071-42c2-8d8f-b61c6817070f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:59.414640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b090de-d071-42c2-8d8f-b61c6817070f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:59.433024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:59.455507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050d15e-284a-4aa3-946d-a61e409f3d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:59.455507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050d15e-284a-4aa3-946d-a61e409f3d8b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:59.455507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050d15e-284a-4aa3-946d-a61e409f3d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:59.455507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050d15e-284a-4aa3-946d-a61e409f3d8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:59.466862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050d15e-284a-4aa3-946d-a61e409f3d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1050d15e-284a-4aa3-946d-a61e409f3d8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:48:59.471840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:48:59.473034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:48:59.473933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 532/1075] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:48:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:48:59.479111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59b1a-65c1-410e-837e-5d2ed4302e82 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:59.580134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59b1a-65c1-410e-837e-5d2ed4302e82 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:59.587387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:48:59.615259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a58c1-ee24-45ee-9716-1606058077ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:59.615875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a58c1-ee24-45ee-9716-1606058077ec None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:59.616152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a58c1-ee24-45ee-9716-1606058077ec None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:59.616421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a58c1-ee24-45ee-9716-1606058077ec None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:59.617243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a58c1-ee24-45ee-9716-1606058077ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:48:59.617591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a58c1-ee24-45ee-9716-1606058077ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:59.618968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a58c1-ee24-45ee-9716-1606058077ec None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:59.632141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 544/1076] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:48:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:59.633514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050d15e-284a-4aa3-946d-a61e409f3d8b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:59.737743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050d15e-284a-4aa3-946d-a61e409f3d8b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:59.771049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed25f-8c0b-451a-a641-c4edf7dd84c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:59.771681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed25f-8c0b-451a-a641-c4edf7dd84c6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:59.771961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed25f-8c0b-451a-a641-c4edf7dd84c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:59.772233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed25f-8c0b-451a-a641-c4edf7dd84c6 None admin] PATH_INFO: `/v3/users/79579ea5541c4655be5a4a01683712d4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:59.773407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bed25f-8c0b-451a-a641-c4edf7dd84c6 None admin] RBAC: Authorizing `identity:get_user(user_id=79579ea5541c4655be5a4a01683712d4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:59.774836 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bed25f-8c0b-451a-a641-c4edf7dd84c6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:59.776592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 533/1077] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:48:59 2022] GET /identity/v3/users/79579ea5541c4655be5a4a01683712d4 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:48:59.782759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a58c1-ee24-45ee-9716-1606058077ec None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:59.888597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a58c1-ee24-45ee-9716-1606058077ec None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:48:59.922300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52186b0-5694-48a5-90c9-fe665485008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:48:59.922935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52186b0-5694-48a5-90c9-fe665485008b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:48:59.923221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52186b0-5694-48a5-90c9-fe665485008b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:48:59.923493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52186b0-5694-48a5-90c9-fe665485008b None admin] PATH_INFO: `/v3/projects/d3905c4f866d475a99441c83a2655605` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:48:59.924661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52186b0-5694-48a5-90c9-fe665485008b None admin] RBAC: Authorizing `identity:get_project(project_id=d3905c4f866d475a99441c83a2655605)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:48:59.926112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52186b0-5694-48a5-90c9-fe665485008b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:48:59.934220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 545/1078] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:48:59 2022] GET /identity/v3/projects/d3905c4f866d475a99441c83a2655605 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:48:59.934361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed25f-8c0b-451a-a641-c4edf7dd84c6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:48:59.978317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:00.036653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed25f-8c0b-451a-a641-c4edf7dd84c6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:00.073313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbe84d-8ddd-4e41-8972-67f88e680ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:00.074265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbe84d-8ddd-4e41-8972-67f88e680ee7 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:00.074708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbe84d-8ddd-4e41-8972-67f88e680ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:00.075182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbe84d-8ddd-4e41-8972-67f88e680ee7 None admin] PATH_INFO: `/v3/projects/d3905c4f866d475a99441c83a2655605/users/79579ea5541c4655be5a4a01683712d4/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:00.077292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbe84d-8ddd-4e41-8972-67f88e680ee7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3905c4f866d475a99441c83a2655605, user_id=79579ea5541c4655be5a4a01683712d4, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:00.079372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbe84d-8ddd-4e41-8972-67f88e680ee7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:00.176163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 534/1079] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:48:59 2022] PUT /identity/v3/projects/d3905c4f866d475a99441c83a2655605/users/79579ea5541c4655be5a4a01683712d4/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:49:00.634323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae508-74b4-40f1-b78d-2a7807dbdd57 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:00.634857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae508-74b4-40f1-b78d-2a7807dbdd57 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:00.634857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae508-74b4-40f1-b78d-2a7807dbdd57 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:00.636347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 546/1080] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:00.642040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82566-8df4-4b33-a43f-94b6fbf299b7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:00.642324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82566-8df4-4b33-a43f-94b6fbf299b7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:00.642596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82566-8df4-4b33-a43f-94b6fbf299b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:00.660670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7cc82566-8df4-4b33-a43f-94b6fbf299b7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:00.661869 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7cc82566-8df4-4b33-a43f-94b6fbf299b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:00.728495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 535/1081] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:00.750655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cae508-74b4-40f1-b78d-2a7807dbdd57 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:00.790842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:00.863205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cae508-74b4-40f1-b78d-2a7807dbdd57 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:00.897908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cc0dd-66e6-4dd8-8921-e4597e8e8aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:00.898446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cc0dd-66e6-4dd8-8921-e4597e8e8aab None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:00.898727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cc0dd-66e6-4dd8-8921-e4597e8e8aab None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:00.899002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cc0dd-66e6-4dd8-8921-e4597e8e8aab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:00.967964 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cc0dd-66e6-4dd8-8921-e4597e8e8aab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:00.969514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cc0dd-66e6-4dd8-8921-e4597e8e8aab None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:00.996995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d4fb6-4fcb-40a0-a7fb-b930d1206173 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:00.997548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d4fb6-4fcb-40a0-a7fb-b930d1206173 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:00.997548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d4fb6-4fcb-40a0-a7fb-b930d1206173 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.000996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 536/1082] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 17:49:01.006787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:01.007692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10562-646d-47a5-ac3e-e6c9c814d4a0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:01.007964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10562-646d-47a5-ac3e-e6c9c814d4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:01.008232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10562-646d-47a5-ac3e-e6c9c814d4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.026239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dbe10562-646d-47a5-ac3e-e6c9c814d4a0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:01.027437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dbe10562-646d-47a5-ac3e-e6c9c814d4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:01.059013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:01.078469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 547/1083] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:01.086297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cc0dd-66e6-4dd8-8921-e4597e8e8aab None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:01.108947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 537/1084] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:49:01.134158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10562-646d-47a5-ac3e-e6c9c814d4a0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:01.218490 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cc0dd-66e6-4dd8-8921-e4597e8e8aab None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:01.245186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10562-646d-47a5-ac3e-e6c9c814d4a0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:01.260355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34437f0f-1dae-4daf-b03f-80867c823f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:01.261360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34437f0f-1dae-4daf-b03f-80867c823f5e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:01.261971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34437f0f-1dae-4daf-b03f-80867c823f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:01.262441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34437f0f-1dae-4daf-b03f-80867c823f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.265610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:01.275618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34437f0f-1dae-4daf-b03f-80867c823f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:01.277241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34437f0f-1dae-4daf-b03f-80867c823f5e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:01.289081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fb3c9-8178-4108-92bf-a17a80172db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:01.289737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fb3c9-8178-4108-92bf-a17a80172db4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:01.290014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fb3c9-8178-4108-92bf-a17a80172db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:01.290288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fb3c9-8178-4108-92bf-a17a80172db4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-34437f0f-1dae-4daf-b03f-80867c823f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:49:01.295530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:01.296606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:01.298284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:49:01.298284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:49:01.298284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:49:01.298284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:01.300110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 548/1085] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:49:01.302269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fb3c9-8178-4108-92bf-a17a80172db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:49:01.305821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34437f0f-1dae-4daf-b03f-80867c823f5e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-420fb3c9-8178-4108-92bf-a17a80172db4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:49:01.307155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:01.308348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:49:01.309232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 538/1086] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 28 17:49:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:49:01.315369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fb3c9-8178-4108-92bf-a17a80172db4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:01.346250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:01.433870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34437f0f-1dae-4daf-b03f-80867c823f5e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:01.441554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fb3c9-8178-4108-92bf-a17a80172db4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:01.488240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f456f7-93d1-41bd-b697-6ba22aa5ad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:01.489211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f456f7-93d1-41bd-b697-6ba22aa5ad57 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:01.489665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f456f7-93d1-41bd-b697-6ba22aa5ad57 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:01.490185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f456f7-93d1-41bd-b697-6ba22aa5ad57 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.492098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f456f7-93d1-41bd-b697-6ba22aa5ad57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:01.492098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f456f7-93d1-41bd-b697-6ba22aa5ad57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:01.493138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f456f7-93d1-41bd-b697-6ba22aa5ad57 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:01.502284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3202f3-47ab-4352-bef1-f2b4a40a9e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:01.503243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3202f3-47ab-4352-bef1-f2b4a40a9e05 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:01.504208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3202f3-47ab-4352-bef1-f2b4a40a9e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:01.504662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3202f3-47ab-4352-bef1-f2b4a40a9e05 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.506040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3202f3-47ab-4352-bef1-f2b4a40a9e05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:01.506543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3202f3-47ab-4352-bef1-f2b4a40a9e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:01.509532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3202f3-47ab-4352-bef1-f2b4a40a9e05 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:01.521263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 549/1087] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:01.524839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 539/1088] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 28 17:49:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:01.535252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f456f7-93d1-41bd-b697-6ba22aa5ad57 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:01.645631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:01.707085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f456f7-93d1-41bd-b697-6ba22aa5ad57 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:01.745193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f8a65-02b0-49f8-bcf5-2ecee80db738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:01.745838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f8a65-02b0-49f8-bcf5-2ecee80db738 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:01.746117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f8a65-02b0-49f8-bcf5-2ecee80db738 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:01.746390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f8a65-02b0-49f8-bcf5-2ecee80db738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.757307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f8a65-02b0-49f8-bcf5-2ecee80db738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:01.758764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f8a65-02b0-49f8-bcf5-2ecee80db738 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-f24f8a65-02b0-49f8-bcf5-2ecee80db738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:49:01.774922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:01.776073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:01.777414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:49:01.777414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:49:01.777414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:49:01.777414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:01.777414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 550/1089] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:49:01.782378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3202f3-47ab-4352-bef1-f2b4a40a9e05 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:01.871119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:01.887167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3202f3-47ab-4352-bef1-f2b4a40a9e05 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:01.921072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8da71-f798-4d1f-8f47-0c70f3454a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:01.921688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8da71-f798-4d1f-8f47-0c70f3454a2e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:01.921964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8da71-f798-4d1f-8f47-0c70f3454a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:01.922234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8da71-f798-4d1f-8f47-0c70f3454a2e None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:01.922918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8da71-f798-4d1f-8f47-0c70f3454a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:01.923220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8da71-f798-4d1f-8f47-0c70f3454a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:01.924566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8da71-f798-4d1f-8f47-0c70f3454a2e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:01.937252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 540/1090] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:01.943718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f8a65-02b0-49f8-bcf5-2ecee80db738 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.041161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:02.045812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f8a65-02b0-49f8-bcf5-2ecee80db738 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.081404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387cee8-4acd-4001-af12-007c7a88a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:02.082255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387cee8-4acd-4001-af12-007c7a88a07e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.082582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387cee8-4acd-4001-af12-007c7a88a07e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.083199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387cee8-4acd-4001-af12-007c7a88a07e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.090750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387cee8-4acd-4001-af12-007c7a88a07e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:02.092175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387cee8-4acd-4001-af12-007c7a88a07e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-4387cee8-4acd-4001-af12-007c7a88a07e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:49:02.103063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:02.104205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:02.105637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 551/1091] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 28 17:49:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:49:02.110407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8da71-f798-4d1f-8f47-0c70f3454a2e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.213363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8da71-f798-4d1f-8f47-0c70f3454a2e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.246470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836f19e-dc9b-4b04-93e2-9fe6f4754c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:02.247085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836f19e-dc9b-4b04-93e2-9fe6f4754c59 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.247365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836f19e-dc9b-4b04-93e2-9fe6f4754c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.247639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836f19e-dc9b-4b04-93e2-9fe6f4754c59 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.248425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836f19e-dc9b-4b04-93e2-9fe6f4754c59 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:02.248730 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836f19e-dc9b-4b04-93e2-9fe6f4754c59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:02.250192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836f19e-dc9b-4b04-93e2-9fe6f4754c59 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:02.272050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 541/1092] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 28 17:49:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:02.273292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387cee8-4acd-4001-af12-007c7a88a07e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.278373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34847090-eac6-4e95-b6a3-e6557fc083a1 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.278656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34847090-eac6-4e95-b6a3-e6557fc083a1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.278934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34847090-eac6-4e95-b6a3-e6557fc083a1 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.280242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 542/1093] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:02.285366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadd753-93c7-492e-bba9-a829bc67dcc8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.285642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadd753-93c7-492e-bba9-a829bc67dcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.285916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadd753-93c7-492e-bba9-a829bc67dcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.292355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:02.303995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1eadd753-93c7-492e-bba9-a829bc67dcc8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:02.307811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1eadd753-93c7-492e-bba9-a829bc67dcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:02.371104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 543/1094] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:49:02.373562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387cee8-4acd-4001-af12-007c7a88a07e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.394906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadd753-93c7-492e-bba9-a829bc67dcc8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.406769 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dae82-7f98-4f4c-970e-08ed67b04757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:02.407428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dae82-7f98-4f4c-970e-08ed67b04757 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.407710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dae82-7f98-4f4c-970e-08ed67b04757 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.407983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dae82-7f98-4f4c-970e-08ed67b04757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.437771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:02.479331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dae82-7f98-4f4c-970e-08ed67b04757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:02.480820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dae82-7f98-4f4c-970e-08ed67b04757 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:02.497841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadd753-93c7-492e-bba9-a829bc67dcc8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.527656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:02.532731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c5feb-32a3-49f8-a601-99c3726e6260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:02.533385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c5feb-32a3-49f8-a601-99c3726e6260 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.533715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c5feb-32a3-49f8-a601-99c3726e6260 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.533997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c5feb-32a3-49f8-a601-99c3726e6260 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.543857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c5feb-32a3-49f8-a601-99c3726e6260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9d2c5feb-32a3-49f8-a601-99c3726e6260 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:49:02.548800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:02.553257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:49:02.554354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 544/1095] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:49:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:49:02.556137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c5feb-32a3-49f8-a601-99c3726e6260 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.579514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 552/1096] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:02.585005 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dae82-7f98-4f4c-970e-08ed67b04757 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.666555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:02.675839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c5feb-32a3-49f8-a601-99c3726e6260 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.706854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dae82-7f98-4f4c-970e-08ed67b04757 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.709430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d3fb-1e04-4cd8-bf6e-b82ed21f4307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:02.710040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d3fb-1e04-4cd8-bf6e-b82ed21f4307 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.710318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d3fb-1e04-4cd8-bf6e-b82ed21f4307 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.710588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d3fb-1e04-4cd8-bf6e-b82ed21f4307 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.711291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d3fb-1e04-4cd8-bf6e-b82ed21f4307 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:02.711593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d3fb-1e04-4cd8-bf6e-b82ed21f4307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:02.712981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d3fb-1e04-4cd8-bf6e-b82ed21f4307 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:02.721624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 545/1097] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:02.727426 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d3fb-1e04-4cd8-bf6e-b82ed21f4307 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.742227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999307-b834-4c9a-aafe-87aedff4ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:02.742865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999307-b834-4c9a-aafe-87aedff4ab08 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.743145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999307-b834-4c9a-aafe-87aedff4ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.743418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999307-b834-4c9a-aafe-87aedff4ab08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.753437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c999307-b834-4c9a-aafe-87aedff4ab08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:02.754880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c999307-b834-4c9a-aafe-87aedff4ab08 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-0c999307-b834-4c9a-aafe-87aedff4ab08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:49:02.769194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:02.770087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:02.770985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:49:02.770985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:49:02.770985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:49:02.770985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:02.770985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 553/1098] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:49:02.775804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999307-b834-4c9a-aafe-87aedff4ab08 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.782909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:02.827365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d3fb-1e04-4cd8-bf6e-b82ed21f4307 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.861197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3ba7e-e1fb-4504-ad22-286fcd28f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:02.861835 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3ba7e-e1fb-4504-ad22-286fcd28f218 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.862111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3ba7e-e1fb-4504-ad22-286fcd28f218 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.862379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3ba7e-e1fb-4504-ad22-286fcd28f218 None admin] PATH_INFO: `/v3/users/79579ea5541c4655be5a4a01683712d4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.864116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3ba7e-e1fb-4504-ad22-286fcd28f218 None admin] RBAC: Authorizing `identity:get_user(user_id=79579ea5541c4655be5a4a01683712d4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:02.865594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3ba7e-e1fb-4504-ad22-286fcd28f218 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:02.867238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 546/1099] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:02 2022] GET /identity/v3/users/79579ea5541c4655be5a4a01683712d4 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:02.872877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3ba7e-e1fb-4504-ad22-286fcd28f218 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.875209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999307-b834-4c9a-aafe-87aedff4ab08 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.887759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:02.908975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c1069-e232-42de-9a81-2fc5699173b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:02.909583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c1069-e232-42de-9a81-2fc5699173b9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:02.909858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c1069-e232-42de-9a81-2fc5699173b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:02.910126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c1069-e232-42de-9a81-2fc5699173b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:02.910800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c1069-e232-42de-9a81-2fc5699173b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:02.911102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c1069-e232-42de-9a81-2fc5699173b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:02.912457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c1069-e232-42de-9a81-2fc5699173b9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:02.923792 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 554/1100] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:02.929493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c1069-e232-42de-9a81-2fc5699173b9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:02.971538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3ba7e-e1fb-4504-ad22-286fcd28f218 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:02.993624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:03.005525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8573f-6ee0-44c5-9bff-618be8148527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:03.006139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8573f-6ee0-44c5-9bff-618be8148527 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:03.006429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8573f-6ee0-44c5-9bff-618be8148527 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:03.006702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8573f-6ee0-44c5-9bff-618be8148527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:03.027574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c1069-e232-42de-9a81-2fc5699173b9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:03.064209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33175db-567f-4bca-9645-d05a9d9a9b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:03.064865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33175db-567f-4bca-9645-d05a9d9a9b28 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:03.065144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33175db-567f-4bca-9645-d05a9d9a9b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:03.065413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33175db-567f-4bca-9645-d05a9d9a9b28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:03.071848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33175db-567f-4bca-9645-d05a9d9a9b28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:03.073378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33175db-567f-4bca-9645-d05a9d9a9b28 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:03.073913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8573f-6ee0-44c5-9bff-618be8148527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:03.075306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8573f-6ee0-44c5-9bff-618be8148527 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-d33175db-567f-4bca-9645-d05a9d9a9b28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:49:03.084448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:03.085431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:03.086338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:49:03.086338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:49:03.086338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:49:03.086338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:49:03.086338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:49:03.086338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:49:03.086338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:49:03.086338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:03.086338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 555/1101] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:49:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 17:49:03.091285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33175db-567f-4bca-9645-d05a9d9a9b28 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:03.122663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:03.173356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 547/1102] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:03.179057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8573f-6ee0-44c5-9bff-618be8148527 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:03.194959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33175db-567f-4bca-9645-d05a9d9a9b28 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:03.203457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:03.229321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0b17-64ad-41e4-9d53-b29ab67728b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:03.229930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0b17-64ad-41e4-9d53-b29ab67728b4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:03.230205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0b17-64ad-41e4-9d53-b29ab67728b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:03.230485 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0b17-64ad-41e4-9d53-b29ab67728b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:03.231221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b0b17-64ad-41e4-9d53-b29ab67728b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:03.231517 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b0b17-64ad-41e4-9d53-b29ab67728b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:03.232961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b0b17-64ad-41e4-9d53-b29ab67728b4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:03.245649 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 556/1103] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:49:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:03.253048 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0b17-64ad-41e4-9d53-b29ab67728b4 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:03.287217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8573f-6ee0-44c5-9bff-618be8148527 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:03.321312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec400d-86ff-4fe8-ba3d-c47acd676997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:03.321956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec400d-86ff-4fe8-ba3d-c47acd676997 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:03.322236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec400d-86ff-4fe8-ba3d-c47acd676997 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:03.322508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec400d-86ff-4fe8-ba3d-c47acd676997 None admin] PATH_INFO: `/v3/projects/d3905c4f866d475a99441c83a2655605` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:03.323668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec400d-86ff-4fe8-ba3d-c47acd676997 None admin] RBAC: Authorizing `identity:get_project(project_id=d3905c4f866d475a99441c83a2655605)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:03.325125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec400d-86ff-4fe8-ba3d-c47acd676997 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:03.326796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 548/1104] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:03 2022] GET /identity/v3/projects/d3905c4f866d475a99441c83a2655605 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:03.332719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec400d-86ff-4fe8-ba3d-c47acd676997 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:03.343288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:03.351979 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0b17-64ad-41e4-9d53-b29ab67728b4 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:03.385823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d95883-2017-4d02-942e-9aca2e1190ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:03.386425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95883-2017-4d02-942e-9aca2e1190ac None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:03.386698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95883-2017-4d02-942e-9aca2e1190ac None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:03.386964 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95883-2017-4d02-942e-9aca2e1190ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:03.387747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d95883-2017-4d02-942e-9aca2e1190ac None admin] RBAC: Adding query filter params (role.id=4063288b76d14443b6b9f188c7d8dfd6, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=cb85b3e1dc464438ac007c1b09ea7fd3) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:03.388052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d95883-2017-4d02-942e-9aca2e1190ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:03.389532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d95883-2017-4d02-942e-9aca2e1190ac None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:03.395816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 557/1105] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:49:03 2022] GET /identity/v3/role_assignments?user.id=cb85b3e1dc464438ac007c1b09ea7fd3&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=4063288b76d14443b6b9f188c7d8dfd6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:03.423545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:03.433849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec400d-86ff-4fe8-ba3d-c47acd676997 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:03.471695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cc666-3dca-4a74-bd96-5fce37d4e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:03.472330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cc666-3dca-4a74-bd96-5fce37d4e296 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:03.472615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cc666-3dca-4a74-bd96-5fce37d4e296 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:03.472917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cc666-3dca-4a74-bd96-5fce37d4e296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:03.473723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cc666-3dca-4a74-bd96-5fce37d4e296 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=d3905c4f866d475a99441c83a2655605, user.id=79579ea5541c4655be5a4a01683712d4) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:03.474038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cc666-3dca-4a74-bd96-5fce37d4e296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:03.475500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cc666-3dca-4a74-bd96-5fce37d4e296 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:03.484329 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 549/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:49:03 2022] GET /identity/v3/role_assignments?user.id=79579ea5541c4655be5a4a01683712d4&scope.project.id=d3905c4f866d475a99441c83a2655605&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:49:05.545430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b6334-d676-41d8-a912-3033febb9538 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:05.545430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b6334-d676-41d8-a912-3033febb9538 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:05.545430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b6334-d676-41d8-a912-3033febb9538 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:05.545430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 558/1107] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:05.550498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e549-a049-4861-b731-c60fc06b2474 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:05.550498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e549-a049-4861-b731-c60fc06b2474 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:05.550498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e549-a049-4861-b731-c60fc06b2474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:05.567941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-caa6e549-a049-4861-b731-c60fc06b2474 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:05.569154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-caa6e549-a049-4861-b731-c60fc06b2474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:05.633314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 550/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:05.657791 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b6334-d676-41d8-a912-3033febb9538 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:05.754910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b6334-d676-41d8-a912-3033febb9538 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:05.786921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa6af4-2d8c-4c5b-bfb3-77c48bd47b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:05.787531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa6af4-2d8c-4c5b-bfb3-77c48bd47b38 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:05.787806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa6af4-2d8c-4c5b-bfb3-77c48bd47b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:05.788074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa6af4-2d8c-4c5b-bfb3-77c48bd47b38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:05.789213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa6af4-2d8c-4c5b-bfb3-77c48bd47b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:05.790625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa6af4-2d8c-4c5b-bfb3-77c48bd47b38 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:05.792150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 559/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:49:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:05.797921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6e549-a049-4861-b731-c60fc06b2474 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:05.879545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:05.894343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6e549-a049-4861-b731-c60fc06b2474 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:05.927624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d65e29-70db-4df0-9493-83477b1cd497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:05.928234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d65e29-70db-4df0-9493-83477b1cd497 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:05.928516 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d65e29-70db-4df0-9493-83477b1cd497 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:05.928813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d65e29-70db-4df0-9493-83477b1cd497 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:05.929490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d65e29-70db-4df0-9493-83477b1cd497 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:05.930910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d65e29-70db-4df0-9493-83477b1cd497 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:06.052581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 551/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:49:05 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:49:08.062063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920819a-e7b9-49ae-aef3-1044737c8ae1 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:08.063329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920819a-e7b9-49ae-aef3-1044737c8ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:08.063422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920819a-e7b9-49ae-aef3-1044737c8ae1 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:08.064721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 560/1111] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:08.069938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0a11c-a49b-4f79-8d5c-5b1cbdb6814a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:08.070319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0a11c-a49b-4f79-8d5c-5b1cbdb6814a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:08.070494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0a11c-a49b-4f79-8d5c-5b1cbdb6814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:08.088976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8bf0a11c-a49b-4f79-8d5c-5b1cbdb6814a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:08.090149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8bf0a11c-a49b-4f79-8d5c-5b1cbdb6814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:08.153952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 552/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:08.177332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920819a-e7b9-49ae-aef3-1044737c8ae1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:08.202379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:08.275377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920819a-e7b9-49ae-aef3-1044737c8ae1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:08.307534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e0cda-8d63-4895-9889-0b286e47dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:08.308152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e0cda-8d63-4895-9889-0b286e47dd4b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:08.308426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e0cda-8d63-4895-9889-0b286e47dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:08.308691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e0cda-8d63-4895-9889-0b286e47dd4b None admin] PATH_INFO: `/v3/roles/5f8cf1f7cff749478558197b9f9ba38d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:08.310101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e0cda-8d63-4895-9889-0b286e47dd4b None admin] RBAC: Authorizing `identity:get_role(role_id=5f8cf1f7cff749478558197b9f9ba38d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:08.311447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e0cda-8d63-4895-9889-0b286e47dd4b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:08.313644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 561/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:08 2022] GET /identity/v3/roles/5f8cf1f7cff749478558197b9f9ba38d => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:08.319558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0a11c-a49b-4f79-8d5c-5b1cbdb6814a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:08.389358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:08.417656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0a11c-a49b-4f79-8d5c-5b1cbdb6814a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:08.450139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2923d-89e0-4b2a-95ad-b67b4cbb7408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:08.450764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2923d-89e0-4b2a-95ad-b67b4cbb7408 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:08.451040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2923d-89e0-4b2a-95ad-b67b4cbb7408 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:08.451307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2923d-89e0-4b2a-95ad-b67b4cbb7408 None admin] PATH_INFO: `/v3/users/6c00ab0ff65d4dfdb206ccc6a47b6def` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:08.463970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2923d-89e0-4b2a-95ad-b67b4cbb7408 None admin] RBAC: Authorizing `identity:get_user(user_id=6c00ab0ff65d4dfdb206ccc6a47b6def)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:08.465706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2923d-89e0-4b2a-95ad-b67b4cbb7408 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:08.467673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 553/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:08 2022] GET /identity/v3/users/6c00ab0ff65d4dfdb206ccc6a47b6def => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:08.473554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e0cda-8d63-4895-9889-0b286e47dd4b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:08.564230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:08.572577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e0cda-8d63-4895-9889-0b286e47dd4b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:08.605410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279a9c9-d59a-43ae-b92d-33c4e6c6a959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:08.606013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a9c9-d59a-43ae-b92d-33c4e6c6a959 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:08.606291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a9c9-d59a-43ae-b92d-33c4e6c6a959 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:08.606563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279a9c9-d59a-43ae-b92d-33c4e6c6a959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:08.672199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279a9c9-d59a-43ae-b92d-33c4e6c6a959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:08.674219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279a9c9-d59a-43ae-b92d-33c4e6c6a959 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:08.760739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:08.770355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 562/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:08.776214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2923d-89e0-4b2a-95ad-b67b4cbb7408 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:08.871829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2923d-89e0-4b2a-95ad-b67b4cbb7408 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:08.898044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:08.905526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f941d9-31e9-4629-bf02-dbc0f03d2add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:08.906159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f941d9-31e9-4629-bf02-dbc0f03d2add None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:08.906441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f941d9-31e9-4629-bf02-dbc0f03d2add None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:08.907250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f941d9-31e9-4629-bf02-dbc0f03d2add None admin] PATH_INFO: `/v3/projects/d3905c4f866d475a99441c83a2655605` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:08.908394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f941d9-31e9-4629-bf02-dbc0f03d2add None admin] RBAC: Authorizing `identity:get_project(project_id=d3905c4f866d475a99441c83a2655605)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:08.909857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f941d9-31e9-4629-bf02-dbc0f03d2add None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:08.911511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 554/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:08 2022] GET /identity/v3/projects/d3905c4f866d475a99441c83a2655605 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:08.917684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279a9c9-d59a-43ae-b92d-33c4e6c6a959 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:09.015360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279a9c9-d59a-43ae-b92d-33c4e6c6a959 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:09.049213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b7bfd-c364-4b17-9929-df3b40856bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:09.049816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b7bfd-c364-4b17-9929-df3b40856bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:09.050094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b7bfd-c364-4b17-9929-df3b40856bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:09.050364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b7bfd-c364-4b17-9929-df3b40856bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:09.051143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b7bfd-c364-4b17-9929-df3b40856bf9 None admin] RBAC: Adding query filter params (role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=d3905c4f866d475a99441c83a2655605, user.id=6c00ab0ff65d4dfdb206ccc6a47b6def) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:09.051452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b7bfd-c364-4b17-9929-df3b40856bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:09.052956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b7bfd-c364-4b17-9929-df3b40856bf9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:09.058206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 563/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:49:08 2022] GET /identity/v3/role_assignments?user.id=6c00ab0ff65d4dfdb206ccc6a47b6def&scope.project.id=d3905c4f866d475a99441c83a2655605&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:11.022287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029192-7272-4568-a2f1-cc07d1c529b3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:11.022854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029192-7272-4568-a2f1-cc07d1c529b3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:11.022854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029192-7272-4568-a2f1-cc07d1c529b3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:11.024195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 555/1118] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:11.029362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6cd7c-32d2-4259-b05d-f9da1ec81525 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:11.029746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6cd7c-32d2-4259-b05d-f9da1ec81525 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:11.029914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6cd7c-32d2-4259-b05d-f9da1ec81525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:11.048691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-1cb6cd7c-32d2-4259-b05d-f9da1ec81525 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:11.049885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1cb6cd7c-32d2-4259-b05d-f9da1ec81525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:11.097577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:11.113452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 564/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:11.135436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029192-7272-4568-a2f1-cc07d1c529b3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:11.236353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029192-7272-4568-a2f1-cc07d1c529b3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:11.269313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636980-17cd-41b7-af62-d44186b7420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:11.269940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636980-17cd-41b7-af62-d44186b7420d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:11.270220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636980-17cd-41b7-af62-d44186b7420d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:11.270494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636980-17cd-41b7-af62-d44186b7420d None admin] PATH_INFO: `/v3/roles/5f8cf1f7cff749478558197b9f9ba38d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:11.271925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636980-17cd-41b7-af62-d44186b7420d None admin] RBAC: Authorizing `identity:get_role(role_id=5f8cf1f7cff749478558197b9f9ba38d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:11.273372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636980-17cd-41b7-af62-d44186b7420d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:11.274677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 556/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:11 2022] GET /identity/v3/roles/5f8cf1f7cff749478558197b9f9ba38d => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:11.280519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6cd7c-32d2-4259-b05d-f9da1ec81525 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:11.375986 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6cd7c-32d2-4259-b05d-f9da1ec81525 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:11.408882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25147755-743d-4f53-bf47-786c35feb84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:11.409501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25147755-743d-4f53-bf47-786c35feb84c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:11.409783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25147755-743d-4f53-bf47-786c35feb84c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:11.410054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25147755-743d-4f53-bf47-786c35feb84c None admin] PATH_INFO: `/v3/users/6c00ab0ff65d4dfdb206ccc6a47b6def` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:11.411200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25147755-743d-4f53-bf47-786c35feb84c None admin] RBAC: Authorizing `identity:get_user(user_id=6c00ab0ff65d4dfdb206ccc6a47b6def)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:11.412627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25147755-743d-4f53-bf47-786c35feb84c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:11.414213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 565/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:11 2022] GET /identity/v3/users/6c00ab0ff65d4dfdb206ccc6a47b6def => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:11.419850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636980-17cd-41b7-af62-d44186b7420d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:11.479882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:11.515634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636980-17cd-41b7-af62-d44186b7420d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:11.552055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0513e-2be6-4356-980e-7d6283677d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:11.552623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0513e-2be6-4356-980e-7d6283677d8a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:11.552930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0513e-2be6-4356-980e-7d6283677d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:11.553206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0513e-2be6-4356-980e-7d6283677d8a None admin] PATH_INFO: `/v3/projects/d3905c4f866d475a99441c83a2655605` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:11.554341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0513e-2be6-4356-980e-7d6283677d8a None admin] RBAC: Authorizing `identity:get_project(project_id=d3905c4f866d475a99441c83a2655605)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:11.555761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0513e-2be6-4356-980e-7d6283677d8a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:11.557441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 557/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:11 2022] GET /identity/v3/projects/d3905c4f866d475a99441c83a2655605 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:11.563617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25147755-743d-4f53-bf47-786c35feb84c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:11.617830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:11.662996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25147755-743d-4f53-bf47-786c35feb84c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:11.695921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d806-89f1-4a3f-8d95-007cdc2da9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:11.696564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d806-89f1-4a3f-8d95-007cdc2da9df None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:11.696869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d806-89f1-4a3f-8d95-007cdc2da9df None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:11.697143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d806-89f1-4a3f-8d95-007cdc2da9df None admin] PATH_INFO: `/v3/projects/d3905c4f866d475a99441c83a2655605/users/6c00ab0ff65d4dfdb206ccc6a47b6def/roles/5f8cf1f7cff749478558197b9f9ba38d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:11.699272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788d806-89f1-4a3f-8d95-007cdc2da9df None admin] RBAC: Authorizing `identity:create_grant(project_id=d3905c4f866d475a99441c83a2655605, user_id=6c00ab0ff65d4dfdb206ccc6a47b6def, role_id=5f8cf1f7cff749478558197b9f9ba38d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:11.700693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788d806-89f1-4a3f-8d95-007cdc2da9df None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:11.778185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 566/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:49:11 2022] PUT /identity/v3/projects/d3905c4f866d475a99441c83a2655605/users/6c00ab0ff65d4dfdb206ccc6a47b6def/roles/5f8cf1f7cff749478558197b9f9ba38d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:49:13.760419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9555c68-a168-4a4b-aaf5-62c1d2d2ca61 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:13.761002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9555c68-a168-4a4b-aaf5-62c1d2d2ca61 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:13.761002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9555c68-a168-4a4b-aaf5-62c1d2d2ca61 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:13.762354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 558/1124] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:13.767553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251098e-9983-4a87-bd43-2bf5b9b28797 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:13.767971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251098e-9983-4a87-bd43-2bf5b9b28797 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:13.768079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251098e-9983-4a87-bd43-2bf5b9b28797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:13.785967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-5251098e-9983-4a87-bd43-2bf5b9b28797 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:13.787122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5251098e-9983-4a87-bd43-2bf5b9b28797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:13.850303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 567/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:13.873807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9555c68-a168-4a4b-aaf5-62c1d2d2ca61 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:13.973706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9555c68-a168-4a4b-aaf5-62c1d2d2ca61 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:14.002081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:14.006715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7b821-d9ba-4768-9ca3-5269b13e3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:14.007348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7b821-d9ba-4768-9ca3-5269b13e3f56 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:14.007625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7b821-d9ba-4768-9ca3-5269b13e3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:14.007899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7b821-d9ba-4768-9ca3-5269b13e3f56 None admin] PATH_INFO: `/v3/roles/5f8cf1f7cff749478558197b9f9ba38d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:14.009342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7b821-d9ba-4768-9ca3-5269b13e3f56 None admin] RBAC: Authorizing `identity:get_role(role_id=5f8cf1f7cff749478558197b9f9ba38d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:14.010749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7b821-d9ba-4768-9ca3-5269b13e3f56 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:14.012035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 559/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:13 2022] GET /identity/v3/roles/5f8cf1f7cff749478558197b9f9ba38d => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:14.017995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251098e-9983-4a87-bd43-2bf5b9b28797 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:14.063922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:14.117405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251098e-9983-4a87-bd43-2bf5b9b28797 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:14.150529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05eb9a-5387-437b-a348-3e07aa36fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:14.151160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05eb9a-5387-437b-a348-3e07aa36fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:14.151465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05eb9a-5387-437b-a348-3e07aa36fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:14.151740 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05eb9a-5387-437b-a348-3e07aa36fbb3 None admin] PATH_INFO: `/v3/users/6c00ab0ff65d4dfdb206ccc6a47b6def` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:14.152906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05eb9a-5387-437b-a348-3e07aa36fbb3 None admin] RBAC: Authorizing `identity:get_user(user_id=6c00ab0ff65d4dfdb206ccc6a47b6def)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:14.154331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05eb9a-5387-437b-a348-3e07aa36fbb3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:14.155901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 568/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:14 2022] GET /identity/v3/users/6c00ab0ff65d4dfdb206ccc6a47b6def => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:14.162215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7b821-d9ba-4768-9ca3-5269b13e3f56 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:14.256906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7b821-d9ba-4768-9ca3-5269b13e3f56 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:14.289673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe41a0b-1642-4d01-b87e-f3390f86b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:14.290220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe41a0b-1642-4d01-b87e-f3390f86b1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:14.290496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe41a0b-1642-4d01-b87e-f3390f86b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:14.290768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe41a0b-1642-4d01-b87e-f3390f86b1e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:14.354977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:14.357112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe41a0b-1642-4d01-b87e-f3390f86b1e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:14.358548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe41a0b-1642-4d01-b87e-f3390f86b1e8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:14.454318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 560/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:14.460245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05eb9a-5387-437b-a348-3e07aa36fbb3 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:14.556535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05eb9a-5387-437b-a348-3e07aa36fbb3 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:14.569313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:14.589184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458f8a0-f712-4754-9a2a-e28bdffdce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:14.589809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f8a0-f712-4754-9a2a-e28bdffdce08 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:14.590086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f8a0-f712-4754-9a2a-e28bdffdce08 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:14.590357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f8a0-f712-4754-9a2a-e28bdffdce08 None admin] PATH_INFO: `/v3/projects/d3905c4f866d475a99441c83a2655605` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:14.591491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458f8a0-f712-4754-9a2a-e28bdffdce08 None admin] RBAC: Authorizing `identity:get_project(project_id=d3905c4f866d475a99441c83a2655605)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:14.592949 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458f8a0-f712-4754-9a2a-e28bdffdce08 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:14.595741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 569/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:14 2022] GET /identity/v3/projects/d3905c4f866d475a99441c83a2655605 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:14.601632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe41a0b-1642-4d01-b87e-f3390f86b1e8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:14.694541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:14.697376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe41a0b-1642-4d01-b87e-f3390f86b1e8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:14.729689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a586d-9bb3-446a-a54c-b9578d7da0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:14.730289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a586d-9bb3-446a-a54c-b9578d7da0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:14.730567 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a586d-9bb3-446a-a54c-b9578d7da0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:14.730839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a586d-9bb3-446a-a54c-b9578d7da0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:14.731611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a586d-9bb3-446a-a54c-b9578d7da0a3 None admin] RBAC: Adding query filter params (role.id=5f8cf1f7cff749478558197b9f9ba38d, scope.project.id=d3905c4f866d475a99441c83a2655605, user.id=6c00ab0ff65d4dfdb206ccc6a47b6def) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:14.731916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a586d-9bb3-446a-a54c-b9578d7da0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:14.733359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a586d-9bb3-446a-a54c-b9578d7da0a3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:14.739441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 561/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:49:14 2022] GET /identity/v3/role_assignments?user.id=6c00ab0ff65d4dfdb206ccc6a47b6def&scope.project.id=d3905c4f866d475a99441c83a2655605&role.id=5f8cf1f7cff749478558197b9f9ba38d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:16.736734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac5101-29a9-4ec1-8e2e-e6cb9e89b5a0 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:16.737321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac5101-29a9-4ec1-8e2e-e6cb9e89b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:16.737321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac5101-29a9-4ec1-8e2e-e6cb9e89b5a0 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:16.738646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 570/1131] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:16.743671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0a748-2d13-4940-86eb-e99bce3a14f8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:16.744043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0a748-2d13-4940-86eb-e99bce3a14f8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:16.744224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0a748-2d13-4940-86eb-e99bce3a14f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:16.762432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cea0a748-2d13-4940-86eb-e99bce3a14f8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:16.763602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cea0a748-2d13-4940-86eb-e99bce3a14f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:16.827177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 562/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:16.849917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac5101-29a9-4ec1-8e2e-e6cb9e89b5a0 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:16.947270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac5101-29a9-4ec1-8e2e-e6cb9e89b5a0 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:16.979669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fc4e4-5590-4c63-84b0-086504bde220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:16.980280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc4e4-5590-4c63-84b0-086504bde220 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:16.980562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc4e4-5590-4c63-84b0-086504bde220 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:16.980858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc4e4-5590-4c63-84b0-086504bde220 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:16.981989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fc4e4-5590-4c63-84b0-086504bde220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:16.983404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fc4e4-5590-4c63-84b0-086504bde220 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:16.985030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 571/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:49:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:16.990660 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0a748-2d13-4940-86eb-e99bce3a14f8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:17.080512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:17.086904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0a748-2d13-4940-86eb-e99bce3a14f8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:17.119824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe89157-a588-4061-b495-e3a8400a1ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:17.120427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe89157-a588-4061-b495-e3a8400a1ae9 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:17.120705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe89157-a588-4061-b495-e3a8400a1ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:17.121097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe89157-a588-4061-b495-e3a8400a1ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:17.121777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe89157-a588-4061-b495-e3a8400a1ae9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:17.123192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe89157-a588-4061-b495-e3a8400a1ae9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:17.243225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 563/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:49:16 2022] POST /identity/v3/projects => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:49:19.283305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd95f-ea7e-4296-bfc9-c9a628bd84c8 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:19.283816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd95f-ea7e-4296-bfc9-c9a628bd84c8 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:19.283907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bd95f-ea7e-4296-bfc9-c9a628bd84c8 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:19.285234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 572/1135] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:19.290249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309c2b6-f6b5-479d-9d1c-08eacdc01077 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:19.290657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309c2b6-f6b5-479d-9d1c-08eacdc01077 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:19.290806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309c2b6-f6b5-479d-9d1c-08eacdc01077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:19.308455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3309c2b6-f6b5-479d-9d1c-08eacdc01077 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:19.309774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3309c2b6-f6b5-479d-9d1c-08eacdc01077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:19.373977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 564/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:19.399617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bd95f-ea7e-4296-bfc9-c9a628bd84c8 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:19.460048 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:19.513822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bd95f-ea7e-4296-bfc9-c9a628bd84c8 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:19.547037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b2215-4142-4019-afe0-6d471cc5fe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:19.547662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b2215-4142-4019-afe0-6d471cc5fe41 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:19.547937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b2215-4142-4019-afe0-6d471cc5fe41 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:19.548209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b2215-4142-4019-afe0-6d471cc5fe41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:19.549352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b2215-4142-4019-afe0-6d471cc5fe41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:19.550770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b2215-4142-4019-afe0-6d471cc5fe41 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:19.552363 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 573/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:49:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:19.558154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309c2b6-f6b5-479d-9d1c-08eacdc01077 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:19.630726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:19.652319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309c2b6-f6b5-479d-9d1c-08eacdc01077 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:19.685601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5099a-3b50-4001-956d-fdd0f314a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:19.686213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5099a-3b50-4001-956d-fdd0f314a6cd None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:19.686489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5099a-3b50-4001-956d-fdd0f314a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:19.686756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5099a-3b50-4001-956d-fdd0f314a6cd None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:19.687822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5099a-3b50-4001-956d-fdd0f314a6cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:19.689278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5099a-3b50-4001-956d-fdd0f314a6cd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:19.814122 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 565/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:49:19 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:49:21.853626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463753-6b2a-4ccd-8fd7-8e00849c683b None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:21.854185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463753-6b2a-4ccd-8fd7-8e00849c683b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:21.854185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463753-6b2a-4ccd-8fd7-8e00849c683b None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:21.855505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 574/1139] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:21.861277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63b3e-3e23-4648-9d5b-ef4288f349c1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:21.861698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63b3e-3e23-4648-9d5b-ef4288f349c1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:21.861807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63b3e-3e23-4648-9d5b-ef4288f349c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:21.879840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-98c63b3e-3e23-4648-9d5b-ef4288f349c1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:21.881040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-98c63b3e-3e23-4648-9d5b-ef4288f349c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:21.946201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 566/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:21.968387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12463753-6b2a-4ccd-8fd7-8e00849c683b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:22.066276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12463753-6b2a-4ccd-8fd7-8e00849c683b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:22.081879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:22.099033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379caf7-be98-433c-a67e-caa0e35234fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:22.099652 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379caf7-be98-433c-a67e-caa0e35234fa None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:22.099931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379caf7-be98-433c-a67e-caa0e35234fa None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:22.100201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379caf7-be98-433c-a67e-caa0e35234fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:22.110290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379caf7-be98-433c-a67e-caa0e35234fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-6379caf7-be98-433c-a67e-caa0e35234fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:49:22.115442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:22.116562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:22.117508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 575/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:49:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:49:22.122509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c63b3e-3e23-4648-9d5b-ef4288f349c1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:22.182821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:22.220878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c63b3e-3e23-4648-9d5b-ef4288f349c1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:22.254241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446acea1-ad55-4418-baaf-168fac9e1b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:22.254880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446acea1-ad55-4418-baaf-168fac9e1b97 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:22.255160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446acea1-ad55-4418-baaf-168fac9e1b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:22.255434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446acea1-ad55-4418-baaf-168fac9e1b97 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:22.256208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446acea1-ad55-4418-baaf-168fac9e1b97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:22.256530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446acea1-ad55-4418-baaf-168fac9e1b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:22.257926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446acea1-ad55-4418-baaf-168fac9e1b97 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:22.265670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 567/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:49:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:22.271931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379caf7-be98-433c-a67e-caa0e35234fa None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:22.370332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379caf7-be98-433c-a67e-caa0e35234fa None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:22.408033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533e52-167b-48ae-bfc9-b1bfd5083d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:22.408663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533e52-167b-48ae-bfc9-b1bfd5083d69 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:22.408974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533e52-167b-48ae-bfc9-b1bfd5083d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:22.409246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533e52-167b-48ae-bfc9-b1bfd5083d69 None admin] PATH_INFO: `/v3/users/05bf63e4ea7c47968804dcad779be7d7` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:22.421847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a533e52-167b-48ae-bfc9-b1bfd5083d69 None admin] RBAC: Authorizing `identity:get_user(user_id=05bf63e4ea7c47968804dcad779be7d7)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:22.423807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a533e52-167b-48ae-bfc9-b1bfd5083d69 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:22.425438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 576/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:22 2022] GET /identity/v3/users/05bf63e4ea7c47968804dcad779be7d7 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:22.431243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446acea1-ad55-4418-baaf-168fac9e1b97 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:22.531575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446acea1-ad55-4418-baaf-168fac9e1b97 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:22.554230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:22.564911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e986dc3-c106-4661-871c-b0a9c892f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:22.565530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e986dc3-c106-4661-871c-b0a9c892f576 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:22.565813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e986dc3-c106-4661-871c-b0a9c892f576 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:22.566090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e986dc3-c106-4661-871c-b0a9c892f576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:22.632300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e986dc3-c106-4661-871c-b0a9c892f576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:22.633701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e986dc3-c106-4661-871c-b0a9c892f576 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:22.728081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 568/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:22.734113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533e52-167b-48ae-bfc9-b1bfd5083d69 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:22.767711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:22.835298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533e52-167b-48ae-bfc9-b1bfd5083d69 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:22.868873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8e3c7-ac5a-4b71-a84a-418e5021cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:22.869510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e3c7-ac5a-4b71-a84a-418e5021cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:22.869784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e3c7-ac5a-4b71-a84a-418e5021cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:22.870053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e3c7-ac5a-4b71-a84a-418e5021cdc4 None admin] PATH_INFO: `/v3/projects/ca5e102f3768476ab53d0e9540b49d1c` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:22.871190 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8e3c7-ac5a-4b71-a84a-418e5021cdc4 None admin] RBAC: Authorizing `identity:get_project(project_id=ca5e102f3768476ab53d0e9540b49d1c)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:22.872612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8e3c7-ac5a-4b71-a84a-418e5021cdc4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:22.874281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 577/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:22 2022] GET /identity/v3/projects/ca5e102f3768476ab53d0e9540b49d1c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:22.880590 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e986dc3-c106-4661-871c-b0a9c892f576 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:22.904307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:22.975859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e986dc3-c106-4661-871c-b0a9c892f576 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:23.008540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18564345-7e0f-4250-9fab-e27ff40bdd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:23.009172 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18564345-7e0f-4250-9fab-e27ff40bdd75 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:23.009455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18564345-7e0f-4250-9fab-e27ff40bdd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:23.009729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18564345-7e0f-4250-9fab-e27ff40bdd75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:23.010502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18564345-7e0f-4250-9fab-e27ff40bdd75 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=ca5e102f3768476ab53d0e9540b49d1c, user.id=05bf63e4ea7c47968804dcad779be7d7) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:23.010809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18564345-7e0f-4250-9fab-e27ff40bdd75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:23.012217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18564345-7e0f-4250-9fab-e27ff40bdd75 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:23.017447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 569/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:49:22 2022] GET /identity/v3/role_assignments?user.id=05bf63e4ea7c47968804dcad779be7d7&scope.project.id=ca5e102f3768476ab53d0e9540b49d1c&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:24.991989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f823d3-a29f-4b74-9846-d49e1d563365 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:24.992549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f823d3-a29f-4b74-9846-d49e1d563365 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:24.992549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f823d3-a29f-4b74-9846-d49e1d563365 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:24.993900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 578/1147] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:24.998954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcbc86-b31c-4ef3-bf67-92c6deceeae8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:24.999376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcbc86-b31c-4ef3-bf67-92c6deceeae8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:24.999480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcbc86-b31c-4ef3-bf67-92c6deceeae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:25.017671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-affcbc86-b31c-4ef3-bf67-92c6deceeae8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:25.018833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-affcbc86-b31c-4ef3-bf67-92c6deceeae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:25.083259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 570/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:49:25.105717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f823d3-a29f-4b74-9846-d49e1d563365 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:25.203521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f823d3-a29f-4b74-9846-d49e1d563365 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:25.204999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:25.236407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ae40-4e1e-465d-9e8b-bf0bc4be58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:25.237056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ae40-4e1e-465d-9e8b-bf0bc4be58d0 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:25.237335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ae40-4e1e-465d-9e8b-bf0bc4be58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:25.237606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ae40-4e1e-465d-9e8b-bf0bc4be58d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:25.247406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5ae40-4e1e-465d-9e8b-bf0bc4be58d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-caf5ae40-4e1e-465d-9e8b-bf0bc4be58d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:49:25.252543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:25.253678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:25.254726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 579/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:49:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:49:25.259714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcbc86-b31c-4ef3-bf67-92c6deceeae8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:25.277471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:25.355889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcbc86-b31c-4ef3-bf67-92c6deceeae8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:25.389086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34bb89-c04a-4609-8977-d44920151039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:25.389721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34bb89-c04a-4609-8977-d44920151039 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:25.390002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34bb89-c04a-4609-8977-d44920151039 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:25.390274 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34bb89-c04a-4609-8977-d44920151039 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:25.391488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34bb89-c04a-4609-8977-d44920151039 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:25.391789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34bb89-c04a-4609-8977-d44920151039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:25.393169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34bb89-c04a-4609-8977-d44920151039 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:25.400980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 571/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:49:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:25.407285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ae40-4e1e-465d-9e8b-bf0bc4be58d0 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:25.505671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ae40-4e1e-465d-9e8b-bf0bc4be58d0 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:25.537502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd08ae-26fd-4c99-98eb-fe5cc6850b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:25.538129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd08ae-26fd-4c99-98eb-fe5cc6850b7d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:25.538411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd08ae-26fd-4c99-98eb-fe5cc6850b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:25.538685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd08ae-26fd-4c99-98eb-fe5cc6850b7d None admin] PATH_INFO: `/v3/users/05bf63e4ea7c47968804dcad779be7d7` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:25.539829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd08ae-26fd-4c99-98eb-fe5cc6850b7d None admin] RBAC: Authorizing `identity:get_user(user_id=05bf63e4ea7c47968804dcad779be7d7)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:25.541288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd08ae-26fd-4c99-98eb-fe5cc6850b7d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:25.542858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 580/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:25 2022] GET /identity/v3/users/05bf63e4ea7c47968804dcad779be7d7 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:25.549141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34bb89-c04a-4609-8977-d44920151039 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:25.627353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:25.645485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34bb89-c04a-4609-8977-d44920151039 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:25.677997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d23b3a-9981-4dcc-bd46-66f4567eff37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:25.678617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23b3a-9981-4dcc-bd46-66f4567eff37 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:25.678897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23b3a-9981-4dcc-bd46-66f4567eff37 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:25.679170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23b3a-9981-4dcc-bd46-66f4567eff37 None admin] PATH_INFO: `/v3/projects/ca5e102f3768476ab53d0e9540b49d1c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:25.680300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23b3a-9981-4dcc-bd46-66f4567eff37 None admin] RBAC: Authorizing `identity:get_project(project_id=ca5e102f3768476ab53d0e9540b49d1c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:25.681737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23b3a-9981-4dcc-bd46-66f4567eff37 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:25.683370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 572/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:25 2022] GET /identity/v3/projects/ca5e102f3768476ab53d0e9540b49d1c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:25.690088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd08ae-26fd-4c99-98eb-fe5cc6850b7d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:25.719747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:25.787274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd08ae-26fd-4c99-98eb-fe5cc6850b7d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:25.819908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fc6f2-716e-4a4c-bd6c-9050a0fc6c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:25.820555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fc6f2-716e-4a4c-bd6c-9050a0fc6c04 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:25.820859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fc6f2-716e-4a4c-bd6c-9050a0fc6c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:25.821135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fc6f2-716e-4a4c-bd6c-9050a0fc6c04 None admin] PATH_INFO: `/v3/projects/ca5e102f3768476ab53d0e9540b49d1c/users/05bf63e4ea7c47968804dcad779be7d7/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:25.823004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fc6f2-716e-4a4c-bd6c-9050a0fc6c04 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca5e102f3768476ab53d0e9540b49d1c, user_id=05bf63e4ea7c47968804dcad779be7d7, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:25.824413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fc6f2-716e-4a4c-bd6c-9050a0fc6c04 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:25.914902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 581/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:49:25 2022] PUT /identity/v3/projects/ca5e102f3768476ab53d0e9540b49d1c/users/05bf63e4ea7c47968804dcad779be7d7/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:49:27.885349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c520b09-8c69-40cd-ac27-74f6bde13823 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:27.885929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c520b09-8c69-40cd-ac27-74f6bde13823 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:27.885929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c520b09-8c69-40cd-ac27-74f6bde13823 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:27.887250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 573/1154] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:27.892928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef91bfb-51c8-4dee-a783-250ad6b3367d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:27.893337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef91bfb-51c8-4dee-a783-250ad6b3367d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:27.893474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef91bfb-51c8-4dee-a783-250ad6b3367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:27.911720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-bef91bfb-51c8-4dee-a783-250ad6b3367d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:27.912933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bef91bfb-51c8-4dee-a783-250ad6b3367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:27.977846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 582/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:28.000953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c520b09-8c69-40cd-ac27-74f6bde13823 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:28.099153 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c520b09-8c69-40cd-ac27-74f6bde13823 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:28.131098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0f299-7b9b-43fd-8a1f-87e3abe8c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:28.131716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0f299-7b9b-43fd-8a1f-87e3abe8c4fa None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:28.131997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0f299-7b9b-43fd-8a1f-87e3abe8c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:28.132270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0f299-7b9b-43fd-8a1f-87e3abe8c4fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:28.142546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0f299-7b9b-43fd-8a1f-87e3abe8c4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7ff0f299-7b9b-43fd-8a1f-87e3abe8c4fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:49:28.147376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:28.148368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:49:28.149238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 574/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:49:28.154422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef91bfb-51c8-4dee-a783-250ad6b3367d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:28.176355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:28.252692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef91bfb-51c8-4dee-a783-250ad6b3367d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:28.285251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037991-7aba-4273-a118-0a7aab23a07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:28.285856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037991-7aba-4273-a118-0a7aab23a07c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:28.286137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037991-7aba-4273-a118-0a7aab23a07c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:28.286410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037991-7aba-4273-a118-0a7aab23a07c None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:28.287123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037991-7aba-4273-a118-0a7aab23a07c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:28.287427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037991-7aba-4273-a118-0a7aab23a07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:28.288871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037991-7aba-4273-a118-0a7aab23a07c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:28.296600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 583/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:49:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:28.303057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0f299-7b9b-43fd-8a1f-87e3abe8c4fa None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:28.314281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:28.405849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0f299-7b9b-43fd-8a1f-87e3abe8c4fa None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:28.439405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f5978-138f-4a3f-bdae-149b28099537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:28.440033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f5978-138f-4a3f-bdae-149b28099537 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:28.440315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f5978-138f-4a3f-bdae-149b28099537 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:28.440607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f5978-138f-4a3f-bdae-149b28099537 None admin] PATH_INFO: `/v3/users/05bf63e4ea7c47968804dcad779be7d7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:28.441812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f5978-138f-4a3f-bdae-149b28099537 None admin] RBAC: Authorizing `identity:get_user(user_id=05bf63e4ea7c47968804dcad779be7d7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:28.443243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f5978-138f-4a3f-bdae-149b28099537 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:28.444865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 575/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:28 2022] GET /identity/v3/users/05bf63e4ea7c47968804dcad779be7d7 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:28.450735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037991-7aba-4273-a118-0a7aab23a07c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:28.529606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:28.546617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037991-7aba-4273-a118-0a7aab23a07c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:28.593276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfc94f-6a72-42ef-bb6a-5a6da44d1c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:28.594873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc94f-6a72-42ef-bb6a-5a6da44d1c88 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:28.595382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc94f-6a72-42ef-bb6a-5a6da44d1c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:28.595880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc94f-6a72-42ef-bb6a-5a6da44d1c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:28.663083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfc94f-6a72-42ef-bb6a-5a6da44d1c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:28.664538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfc94f-6a72-42ef-bb6a-5a6da44d1c88 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:28.747469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:28.766285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 584/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:28.772346 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f5978-138f-4a3f-bdae-149b28099537 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:28.846549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:28.868628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f5978-138f-4a3f-bdae-149b28099537 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:28.902408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e030f6-647c-4289-9e7e-5dbe43231293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:28.903036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e030f6-647c-4289-9e7e-5dbe43231293 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:28.903316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e030f6-647c-4289-9e7e-5dbe43231293 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:28.903589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e030f6-647c-4289-9e7e-5dbe43231293 None admin] PATH_INFO: `/v3/projects/ca5e102f3768476ab53d0e9540b49d1c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:28.904733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e030f6-647c-4289-9e7e-5dbe43231293 None admin] RBAC: Authorizing `identity:get_project(project_id=ca5e102f3768476ab53d0e9540b49d1c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:28.906175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e030f6-647c-4289-9e7e-5dbe43231293 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:28.907818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 576/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:28 2022] GET /identity/v3/projects/ca5e102f3768476ab53d0e9540b49d1c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:28.914011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfc94f-6a72-42ef-bb6a-5a6da44d1c88 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:29.009074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfc94f-6a72-42ef-bb6a-5a6da44d1c88 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:29.041921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b4ebc-ef18-4b96-a7b0-88a9b8d8b965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:29.042522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b4ebc-ef18-4b96-a7b0-88a9b8d8b965 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:29.042800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b4ebc-ef18-4b96-a7b0-88a9b8d8b965 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:29.043072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b4ebc-ef18-4b96-a7b0-88a9b8d8b965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:29.043853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b4ebc-ef18-4b96-a7b0-88a9b8d8b965 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=ca5e102f3768476ab53d0e9540b49d1c, user.id=05bf63e4ea7c47968804dcad779be7d7) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:29.044163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b4ebc-ef18-4b96-a7b0-88a9b8d8b965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:29.045615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b4ebc-ef18-4b96-a7b0-88a9b8d8b965 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:29.051314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 585/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:49:28 2022] GET /identity/v3/role_assignments?user.id=05bf63e4ea7c47968804dcad779be7d7&scope.project.id=ca5e102f3768476ab53d0e9540b49d1c&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:31.055674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9b792-b127-4b8e-8acc-47af3d1b46c9 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:31.056272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9b792-b127-4b8e-8acc-47af3d1b46c9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:31.056272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9b792-b127-4b8e-8acc-47af3d1b46c9 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:31.057621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 577/1162] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:31.063260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b92cf2-799d-4a1f-800f-294b07c01c07 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:31.063656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b92cf2-799d-4a1f-800f-294b07c01c07 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:31.063814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b92cf2-799d-4a1f-800f-294b07c01c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:31.082000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-25b92cf2-799d-4a1f-800f-294b07c01c07 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:31.083177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-25b92cf2-799d-4a1f-800f-294b07c01c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:31.123466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:31.147848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 586/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:31.169839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9b792-b127-4b8e-8acc-47af3d1b46c9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:31.269328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9b792-b127-4b8e-8acc-47af3d1b46c9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:31.300904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491ae3-fadd-46f2-b94a-155f568d8b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:31.301509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491ae3-fadd-46f2-b94a-155f568d8b18 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:31.301789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491ae3-fadd-46f2-b94a-155f568d8b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:31.302064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491ae3-fadd-46f2-b94a-155f568d8b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:31.316263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:31.367484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3491ae3-fadd-46f2-b94a-155f568d8b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:31.368943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3491ae3-fadd-46f2-b94a-155f568d8b18 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:31.462243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 578/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:31.469377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b92cf2-799d-4a1f-800f-294b07c01c07 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:31.573877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b92cf2-799d-4a1f-800f-294b07c01c07 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:31.607518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709da3e5-a567-488e-8d2f-e4f046628474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:31.608148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709da3e5-a567-488e-8d2f-e4f046628474 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:31.608425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709da3e5-a567-488e-8d2f-e4f046628474 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:31.608694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709da3e5-a567-488e-8d2f-e4f046628474 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:31.615197 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709da3e5-a567-488e-8d2f-e4f046628474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:31.616629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709da3e5-a567-488e-8d2f-e4f046628474 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-709da3e5-a567-488e-8d2f-e4f046628474 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:31.627794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:31.629118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:31.630059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 587/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:49:31 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:49:31.635111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491ae3-fadd-46f2-b94a-155f568d8b18 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:31.678980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:31.732155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491ae3-fadd-46f2-b94a-155f568d8b18 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:31.765335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac9593-d4ff-4994-b477-709b4e5a6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:31.766489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac9593-d4ff-4994-b477-709b4e5a6355 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:31.766765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac9593-d4ff-4994-b477-709b4e5a6355 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:31.767033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac9593-d4ff-4994-b477-709b4e5a6355 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:31.767710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac9593-d4ff-4994-b477-709b4e5a6355 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:31.768011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac9593-d4ff-4994-b477-709b4e5a6355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:31.769393 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac9593-d4ff-4994-b477-709b4e5a6355 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:31.776254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 579/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 28 17:49:31 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:33.740913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561ecb-ad53-42ca-a8fe-454c42a7e4ce None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:33.741454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561ecb-ad53-42ca-a8fe-454c42a7e4ce None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:33.741454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561ecb-ad53-42ca-a8fe-454c42a7e4ce None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:33.742828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 588/1167] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:33.747965 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b5a4c-3664-4344-b60a-f6a67b98f7a1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:33.748356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b5a4c-3664-4344-b60a-f6a67b98f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:33.748525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b5a4c-3664-4344-b60a-f6a67b98f7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:33.767276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-305b5a4c-3664-4344-b60a-f6a67b98f7a1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:33.768458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-305b5a4c-3664-4344-b60a-f6a67b98f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:33.833265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 580/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:33.856177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561ecb-ad53-42ca-a8fe-454c42a7e4ce None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:33.895540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:33.959223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561ecb-ad53-42ca-a8fe-454c42a7e4ce None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:33.991779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c6c93-36bd-466b-b686-ff0de3ba70a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:33.992318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c6c93-36bd-466b-b686-ff0de3ba70a8 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:33.992589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c6c93-36bd-466b-b686-ff0de3ba70a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:33.992882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c6c93-36bd-466b-b686-ff0de3ba70a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:33.993583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c6c93-36bd-466b-b686-ff0de3ba70a8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:33.994921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c6c93-36bd-466b-b686-ff0de3ba70a8 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:34.076479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 589/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Thu Jul 28 17:49:33 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:49:36.106775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d13d2a-c61a-4bad-be82-acea8905a48b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:36.107336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d13d2a-c61a-4bad-be82-acea8905a48b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:36.107336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d13d2a-c61a-4bad-be82-acea8905a48b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:36.108672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 581/1170] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:36.114422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d25b4-54cc-4112-9093-bf05f88ab5fc None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:36.114827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d25b4-54cc-4112-9093-bf05f88ab5fc None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:36.114963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d25b4-54cc-4112-9093-bf05f88ab5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:36.133021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-dd6d25b4-54cc-4112-9093-bf05f88ab5fc None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:36.134182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-dd6d25b4-54cc-4112-9093-bf05f88ab5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:36.198393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 590/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:36.221161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d13d2a-c61a-4bad-be82-acea8905a48b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:36.261006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:36.319156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d13d2a-c61a-4bad-be82-acea8905a48b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:36.351434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc7d19-cacb-4e6a-9d60-678bbd2aa0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:36.352061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc7d19-cacb-4e6a-9d60-678bbd2aa0bf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:36.352339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc7d19-cacb-4e6a-9d60-678bbd2aa0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:36.352610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc7d19-cacb-4e6a-9d60-678bbd2aa0bf None admin] PATH_INFO: `/v3/domains/93473b68498e4dc59c18181f6d5c9552` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:36.363242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc7d19-cacb-4e6a-9d60-678bbd2aa0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=93473b68498e4dc59c18181f6d5c9552)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:36.364619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc7d19-cacb-4e6a-9d60-678bbd2aa0bf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:36.366238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 582/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Thu Jul 28 17:49:36 2022] GET /identity/v3/domains/93473b68498e4dc59c18181f6d5c9552 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:36.372072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d25b4-54cc-4112-9093-bf05f88ab5fc None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:36.397705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:36.467965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d25b4-54cc-4112-9093-bf05f88ab5fc None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:36.501031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05a429-8fa4-453d-911d-4a0b0d14817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:36.501631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05a429-8fa4-453d-911d-4a0b0d14817d None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:36.501910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05a429-8fa4-453d-911d-4a0b0d14817d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:36.502182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05a429-8fa4-453d-911d-4a0b0d14817d None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:36.502862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05a429-8fa4-453d-911d-4a0b0d14817d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:36.504275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05a429-8fa4-453d-911d-4a0b0d14817d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:36.579337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 591/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:49:36 2022] POST /identity/v3/projects => generated 361 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:49:38.593523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3b3c7-fbac-4678-ae02-832e6cedab63 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:38.594126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3b3c7-fbac-4678-ae02-832e6cedab63 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:38.594126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3b3c7-fbac-4678-ae02-832e6cedab63 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:38.595390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 583/1174] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:38.600567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56095227-0ec0-4738-9b25-ca1f5e3416d8 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:38.600973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56095227-0ec0-4738-9b25-ca1f5e3416d8 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:38.601157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56095227-0ec0-4738-9b25-ca1f5e3416d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:38.618748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-56095227-0ec0-4738-9b25-ca1f5e3416d8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:38.619912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-56095227-0ec0-4738-9b25-ca1f5e3416d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:38.685197 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 592/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:38.713593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3b3c7-fbac-4678-ae02-832e6cedab63 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:38.808765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:38.813537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3b3c7-fbac-4678-ae02-832e6cedab63 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:38.846490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078aa98-bb61-44e0-80aa-bc92b76ff0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:38.847057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078aa98-bb61-44e0-80aa-bc92b76ff0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:38.847336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078aa98-bb61-44e0-80aa-bc92b76ff0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:38.847607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078aa98-bb61-44e0-80aa-bc92b76ff0e6 None admin] PATH_INFO: `/v3/domains/93473b68498e4dc59c18181f6d5c9552` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:38.848737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078aa98-bb61-44e0-80aa-bc92b76ff0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=93473b68498e4dc59c18181f6d5c9552)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:38.850182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078aa98-bb61-44e0-80aa-bc92b76ff0e6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:38.851749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 584/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Thu Jul 28 17:49:38 2022] GET /identity/v3/domains/93473b68498e4dc59c18181f6d5c9552 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:38.857615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56095227-0ec0-4738-9b25-ca1f5e3416d8 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:38.868282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:38.955199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56095227-0ec0-4738-9b25-ca1f5e3416d8 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:38.988885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd4762-3272-45c4-b825-1101ace8f039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:38.989508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4762-3272-45c4-b825-1101ace8f039 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:38.989802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4762-3272-45c4-b825-1101ace8f039 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:38.990086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4762-3272-45c4-b825-1101ace8f039 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:38.990783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd4762-3272-45c4-b825-1101ace8f039 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:38.992219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd4762-3272-45c4-b825-1101ace8f039 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:39.098285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 593/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:49:38 2022] POST /identity/v3/users => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:49:41.120575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf0df-bba9-421a-9f11-8d50ceb087db None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:41.121157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf0df-bba9-421a-9f11-8d50ceb087db None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:41.121157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf0df-bba9-421a-9f11-8d50ceb087db None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:41.122547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 585/1178] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:41.127679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0126b-5463-428f-b8b1-8d1f7468d274 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:41.128098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0126b-5463-428f-b8b1-8d1f7468d274 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:41.128220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0126b-5463-428f-b8b1-8d1f7468d274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:41.146919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-24b0126b-5463-428f-b8b1-8d1f7468d274 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:41.148073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-24b0126b-5463-428f-b8b1-8d1f7468d274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:41.205839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:41.213893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 594/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:41.237674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf0df-bba9-421a-9f11-8d50ceb087db None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:41.335547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf0df-bba9-421a-9f11-8d50ceb087db None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:41.367526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceaa3d-ca75-4243-a467-4ad0fdda095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:41.368142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceaa3d-ca75-4243-a467-4ad0fdda095c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:41.368416 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceaa3d-ca75-4243-a467-4ad0fdda095c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:41.368680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceaa3d-ca75-4243-a467-4ad0fdda095c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:41.378862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ceaa3d-ca75-4243-a467-4ad0fdda095c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-62ceaa3d-ca75-4243-a467-4ad0fdda095c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:49:41.383615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:41.384755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:49:41.385999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 586/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:49:41.390688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0126b-5463-428f-b8b1-8d1f7468d274 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:41.484133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0126b-5463-428f-b8b1-8d1f7468d274 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:41.516712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf24bd-adac-4d43-92df-17d973c4b46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:41.517327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf24bd-adac-4d43-92df-17d973c4b46b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:41.517600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf24bd-adac-4d43-92df-17d973c4b46b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:41.517866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf24bd-adac-4d43-92df-17d973c4b46b None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:41.518562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf24bd-adac-4d43-92df-17d973c4b46b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:41.518860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf24bd-adac-4d43-92df-17d973c4b46b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:41.520203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf24bd-adac-4d43-92df-17d973c4b46b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:41.527816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 595/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:49:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:41.533841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceaa3d-ca75-4243-a467-4ad0fdda095c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:41.561687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:41.635854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceaa3d-ca75-4243-a467-4ad0fdda095c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:41.669206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc949-3cb2-46b4-8554-d93bce8d7427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:41.669832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc949-3cb2-46b4-8554-d93bce8d7427 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:41.670111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc949-3cb2-46b4-8554-d93bce8d7427 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:41.670384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc949-3cb2-46b4-8554-d93bce8d7427 None admin] PATH_INFO: `/v3/users/b379d73934594270863b3a00afdc7f84` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:41.683422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbc949-3cb2-46b4-8554-d93bce8d7427 None admin] RBAC: Authorizing `identity:get_user(user_id=b379d73934594270863b3a00afdc7f84)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:41.684878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbc949-3cb2-46b4-8554-d93bce8d7427 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:41.686470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 587/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:41 2022] GET /identity/v3/users/b379d73934594270863b3a00afdc7f84 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:41.692597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf24bd-adac-4d43-92df-17d973c4b46b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:41.746574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:41.788160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf24bd-adac-4d43-92df-17d973c4b46b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:41.820251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e373-c3d4-4011-802c-9950bb11b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:41.820870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e373-c3d4-4011-802c-9950bb11b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:41.821147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e373-c3d4-4011-802c-9950bb11b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:41.821416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e373-c3d4-4011-802c-9950bb11b9f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:41.885584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294e373-c3d4-4011-802c-9950bb11b9f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:41.887073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294e373-c3d4-4011-802c-9950bb11b9f6 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:41.939171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:41.981129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 596/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:41.987220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc949-3cb2-46b4-8554-d93bce8d7427 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:42.068054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:42.083449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc949-3cb2-46b4-8554-d93bce8d7427 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:42.116657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a35e-9788-4a5a-b10f-acc5b2ca6f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:42.117318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a35e-9788-4a5a-b10f-acc5b2ca6f85 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:42.117601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a35e-9788-4a5a-b10f-acc5b2ca6f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:42.117875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a35e-9788-4a5a-b10f-acc5b2ca6f85 None admin] PATH_INFO: `/v3/projects/12cdab244de44622a9338c40476cd63c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:42.119017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767a35e-9788-4a5a-b10f-acc5b2ca6f85 None admin] RBAC: Authorizing `identity:get_project(project_id=12cdab244de44622a9338c40476cd63c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:42.120464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767a35e-9788-4a5a-b10f-acc5b2ca6f85 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:42.122159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 588/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:41 2022] GET /identity/v3/projects/12cdab244de44622a9338c40476cd63c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:42.129121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e373-c3d4-4011-802c-9950bb11b9f6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:42.225277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e373-c3d4-4011-802c-9950bb11b9f6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:42.258348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a439-858a-42b8-93a6-0212b1570ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:42.258945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a439-858a-42b8-93a6-0212b1570ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:42.259218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a439-858a-42b8-93a6-0212b1570ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:42.259488 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a439-858a-42b8-93a6-0212b1570ab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:42.260258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27a439-858a-42b8-93a6-0212b1570ab4 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=12cdab244de44622a9338c40476cd63c, user.id=b379d73934594270863b3a00afdc7f84) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:42.260561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27a439-858a-42b8-93a6-0212b1570ab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:42.262000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27a439-858a-42b8-93a6-0212b1570ab4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:42.267214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 597/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:49:42 2022] GET /identity/v3/role_assignments?user.id=b379d73934594270863b3a00afdc7f84&scope.project.id=12cdab244de44622a9338c40476cd63c&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:44.234273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a62f2-a372-4d49-92c6-157c640c354c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:44.234800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a62f2-a372-4d49-92c6-157c640c354c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:44.234800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a62f2-a372-4d49-92c6-157c640c354c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:44.236186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 589/1186] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:44.241411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0678796-0f54-4b9a-b9fb-76bec158ef57 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:44.241797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0678796-0f54-4b9a-b9fb-76bec158ef57 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:44.241960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0678796-0f54-4b9a-b9fb-76bec158ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:44.259588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a0678796-0f54-4b9a-b9fb-76bec158ef57 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:44.260771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a0678796-0f54-4b9a-b9fb-76bec158ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:44.275008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:44.326893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 598/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:44.349558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a62f2-a372-4d49-92c6-157c640c354c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:44.446854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a62f2-a372-4d49-92c6-157c640c354c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:44.478171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecf76e-90c9-436a-a756-176808270339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:44.478782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf76e-90c9-436a-a756-176808270339 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:44.479060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf76e-90c9-436a-a756-176808270339 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:44.479329 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf76e-90c9-436a-a756-176808270339 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:44.489536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecf76e-90c9-436a-a756-176808270339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-07ecf76e-90c9-436a-a756-176808270339 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:49:44.494338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:44.495437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:49:44.496564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 590/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:49:44.501895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0678796-0f54-4b9a-b9fb-76bec158ef57 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:44.604995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0678796-0f54-4b9a-b9fb-76bec158ef57 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:44.641703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232a7c3-6779-4612-abb0-dd8009e23e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:44.642317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232a7c3-6779-4612-abb0-dd8009e23e9b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:44.642605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232a7c3-6779-4612-abb0-dd8009e23e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:44.642879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232a7c3-6779-4612-abb0-dd8009e23e9b None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:44.643591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232a7c3-6779-4612-abb0-dd8009e23e9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:44.643895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232a7c3-6779-4612-abb0-dd8009e23e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:44.645358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232a7c3-6779-4612-abb0-dd8009e23e9b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:44.653380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 599/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:44.659826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecf76e-90c9-436a-a756-176808270339 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:44.675398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:44.757563 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecf76e-90c9-436a-a756-176808270339 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:44.794173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec870b-7f75-4419-ad87-0113cc3f37ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:44.794803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec870b-7f75-4419-ad87-0113cc3f37ed None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:44.795083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec870b-7f75-4419-ad87-0113cc3f37ed None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:44.795360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec870b-7f75-4419-ad87-0113cc3f37ed None admin] PATH_INFO: `/v3/users/b379d73934594270863b3a00afdc7f84` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:44.796522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec870b-7f75-4419-ad87-0113cc3f37ed None admin] RBAC: Authorizing `identity:get_user(user_id=b379d73934594270863b3a00afdc7f84)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:44.798576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec870b-7f75-4419-ad87-0113cc3f37ed None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:44.800181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 591/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:44 2022] GET /identity/v3/users/b379d73934594270863b3a00afdc7f84 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:44.805951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232a7c3-6779-4612-abb0-dd8009e23e9b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:44.821243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:44.903953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232a7c3-6779-4612-abb0-dd8009e23e9b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:44.937699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed66f8-e7a0-43b9-9eaf-4662928dbba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:44.938593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed66f8-e7a0-43b9-9eaf-4662928dbba2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:44.938872 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed66f8-e7a0-43b9-9eaf-4662928dbba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:44.939146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed66f8-e7a0-43b9-9eaf-4662928dbba2 None admin] PATH_INFO: `/v3/projects/12cdab244de44622a9338c40476cd63c` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:44.940296 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed66f8-e7a0-43b9-9eaf-4662928dbba2 None admin] RBAC: Authorizing `identity:get_project(project_id=12cdab244de44622a9338c40476cd63c)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:44.941757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed66f8-e7a0-43b9-9eaf-4662928dbba2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:44.943414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 600/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:44 2022] GET /identity/v3/projects/12cdab244de44622a9338c40476cd63c => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:44.949465 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec870b-7f75-4419-ad87-0113cc3f37ed None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:45.028517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:45.047145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec870b-7f75-4419-ad87-0113cc3f37ed None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:45.081531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036c68e-4d02-456a-b198-d6f33f5f33d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:45.082187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036c68e-4d02-456a-b198-d6f33f5f33d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:45.082468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036c68e-4d02-456a-b198-d6f33f5f33d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:45.082742 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036c68e-4d02-456a-b198-d6f33f5f33d2 None admin] PATH_INFO: `/v3/projects/12cdab244de44622a9338c40476cd63c/users/b379d73934594270863b3a00afdc7f84/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:45.084652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036c68e-4d02-456a-b198-d6f33f5f33d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=12cdab244de44622a9338c40476cd63c, user_id=b379d73934594270863b3a00afdc7f84, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:45.086106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036c68e-4d02-456a-b198-d6f33f5f33d2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:45.178873 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 592/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:49:44 2022] PUT /identity/v3/projects/12cdab244de44622a9338c40476cd63c/users/b379d73934594270863b3a00afdc7f84/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:49:47.115704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bb5bc-48fd-48fe-857e-51f100d72b1d None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:47.116259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bb5bc-48fd-48fe-857e-51f100d72b1d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:47.116259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bb5bc-48fd-48fe-857e-51f100d72b1d None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:47.117638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 601/1193] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:49:47.122594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947ecb-f877-4f4e-8726-363b15c74c56 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:47.122967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947ecb-f877-4f4e-8726-363b15c74c56 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:47.123139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947ecb-f877-4f4e-8726-363b15c74c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:47.141138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3e947ecb-f877-4f4e-8726-363b15c74c56 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:49:47.142302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3e947ecb-f877-4f4e-8726-363b15c74c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:49:47.206829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 593/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:49:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:49:47.229503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bb5bc-48fd-48fe-857e-51f100d72b1d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:47.315535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:47.335844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bb5bc-48fd-48fe-857e-51f100d72b1d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:47.369016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f829bb-9c6e-4bcb-8e76-e380a7fa4db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:47.369588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f829bb-9c6e-4bcb-8e76-e380a7fa4db6 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:47.369870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f829bb-9c6e-4bcb-8e76-e380a7fa4db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:47.370144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f829bb-9c6e-4bcb-8e76-e380a7fa4db6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:47.380380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f829bb-9c6e-4bcb-8e76-e380a7fa4db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-83f829bb-9c6e-4bcb-8e76-e380a7fa4db6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:49:47.385241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:49:47.386351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:49:47.387548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 602/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:49:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:49:47.393015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947ecb-f877-4f4e-8726-363b15c74c56 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:47.459382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:47.489010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947ecb-f877-4f4e-8726-363b15c74c56 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:47.521572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253ad7-9581-4bcb-b4ba-470a48b8c2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:47.522602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253ad7-9581-4bcb-b4ba-470a48b8c2cc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:47.522884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253ad7-9581-4bcb-b4ba-470a48b8c2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:47.523155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253ad7-9581-4bcb-b4ba-470a48b8c2cc None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:47.523861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253ad7-9581-4bcb-b4ba-470a48b8c2cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:47.524171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253ad7-9581-4bcb-b4ba-470a48b8c2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:47.525557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253ad7-9581-4bcb-b4ba-470a48b8c2cc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:47.533809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 594/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:49:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:47.539650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f829bb-9c6e-4bcb-8e76-e380a7fa4db6 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:47.637059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f829bb-9c6e-4bcb-8e76-e380a7fa4db6 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:47.669304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45187487-5b40-4ceb-af48-66c0448f1c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:47.669923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45187487-5b40-4ceb-af48-66c0448f1c4c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:47.670205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45187487-5b40-4ceb-af48-66c0448f1c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:47.670480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45187487-5b40-4ceb-af48-66c0448f1c4c None admin] PATH_INFO: `/v3/users/b379d73934594270863b3a00afdc7f84` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:47.671639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45187487-5b40-4ceb-af48-66c0448f1c4c None admin] RBAC: Authorizing `identity:get_user(user_id=b379d73934594270863b3a00afdc7f84)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:47.673606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45187487-5b40-4ceb-af48-66c0448f1c4c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:47.675179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 603/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 28 17:49:47 2022] GET /identity/v3/users/b379d73934594270863b3a00afdc7f84 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:47.680864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253ad7-9581-4bcb-b4ba-470a48b8c2cc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:47.775667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253ad7-9581-4bcb-b4ba-470a48b8c2cc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:47.803785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:47.808575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03c7c7-3908-47a0-9951-c8fd74037efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:47.815330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03c7c7-3908-47a0-9951-c8fd74037efd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:47.815330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03c7c7-3908-47a0-9951-c8fd74037efd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:47.815330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03c7c7-3908-47a0-9951-c8fd74037efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:47.873586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03c7c7-3908-47a0-9951-c8fd74037efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:47.875054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03c7c7-3908-47a0-9951-c8fd74037efd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:47.968692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 595/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:49:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:49:47.974593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45187487-5b40-4ceb-af48-66c0448f1c4c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:47.986029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:48.071379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45187487-5b40-4ceb-af48-66c0448f1c4c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:48.103287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28176c0d-6911-4ed3-946f-c70b4fe6ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:48.103906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176c0d-6911-4ed3-946f-c70b4fe6ae81 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:48.104186 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176c0d-6911-4ed3-946f-c70b4fe6ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:48.104457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176c0d-6911-4ed3-946f-c70b4fe6ae81 None admin] PATH_INFO: `/v3/projects/12cdab244de44622a9338c40476cd63c` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:48.105614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28176c0d-6911-4ed3-946f-c70b4fe6ae81 None admin] RBAC: Authorizing `identity:get_project(project_id=12cdab244de44622a9338c40476cd63c)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:48.107035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28176c0d-6911-4ed3-946f-c70b4fe6ae81 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:48.108648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 604/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 28 17:49:47 2022] GET /identity/v3/projects/12cdab244de44622a9338c40476cd63c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:48.115291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03c7c7-3908-47a0-9951-c8fd74037efd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:49:48.145008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:48.212051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03c7c7-3908-47a0-9951-c8fd74037efd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:49:48.244561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92844-85cf-4614-877f-084b7f27ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:49:48.245138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92844-85cf-4614-877f-084b7f27ad75 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:49:48.245419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92844-85cf-4614-877f-084b7f27ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:49:48.245697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92844-85cf-4614-877f-084b7f27ad75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:49:48.246478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e92844-85cf-4614-877f-084b7f27ad75 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=12cdab244de44622a9338c40476cd63c, user.id=b379d73934594270863b3a00afdc7f84) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:49:48.246789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e92844-85cf-4614-877f-084b7f27ad75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:49:48.248208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e92844-85cf-4614-877f-084b7f27ad75 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:49:48.254342 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 596/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:49:48 2022] GET /identity/v3/role_assignments?user.id=b379d73934594270863b3a00afdc7f84&scope.project.id=12cdab244de44622a9338c40476cd63c&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:49:58.099276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=62 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:49:58.251782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=52 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:05.933172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f8d26-d3bf-46ab-83f0-a24fc414defc None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:05.933774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f8d26-d3bf-46ab-83f0-a24fc414defc None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:05.933774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f8d26-d3bf-46ab-83f0-a24fc414defc None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:05.935209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 605/1201] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:05.941221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a4a9-83be-4d03-baad-b9275b5181bf None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:05.941643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a4a9-83be-4d03-baad-b9275b5181bf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:05.941771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a4a9-83be-4d03-baad-b9275b5181bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:05.959610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8110a4a9-83be-4d03-baad-b9275b5181bf None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:05.960857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8110a4a9-83be-4d03-baad-b9275b5181bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:06.026669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 597/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:06.050923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f8d26-d3bf-46ab-83f0-a24fc414defc None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:06.151053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f8d26-d3bf-46ab-83f0-a24fc414defc None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:06.184050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0da7a9-d339-4aa3-acee-4b9b6eb17114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:06.184625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0da7a9-d339-4aa3-acee-4b9b6eb17114 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:06.184942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0da7a9-d339-4aa3-acee-4b9b6eb17114 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:06.185218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0da7a9-d339-4aa3-acee-4b9b6eb17114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:06.196609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0da7a9-d339-4aa3-acee-4b9b6eb17114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:06.198084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0da7a9-d339-4aa3-acee-4b9b6eb17114 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-dd0da7a9-d339-4aa3-acee-4b9b6eb17114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:06.214180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:06.215412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:06.216543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:06.216543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:06.216543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:06.216543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:06.216543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 606/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:06.221344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a4a9-83be-4d03-baad-b9275b5181bf None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:06.319374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a4a9-83be-4d03-baad-b9275b5181bf None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:06.347374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:06.352953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd4754-dffd-4727-94c7-6ae3b161ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:06.353609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4754-dffd-4727-94c7-6ae3b161ef81 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:06.353943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4754-dffd-4727-94c7-6ae3b161ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:06.354156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4754-dffd-4727-94c7-6ae3b161ef81 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:06.354834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd4754-dffd-4727-94c7-6ae3b161ef81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:06.355130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd4754-dffd-4727-94c7-6ae3b161ef81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:06.356485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd4754-dffd-4727-94c7-6ae3b161ef81 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:06.368008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 598/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:06.374417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0da7a9-d339-4aa3-acee-4b9b6eb17114 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:06.427564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:06.473864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0da7a9-d339-4aa3-acee-4b9b6eb17114 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:06.513955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb8dce-5388-4ed9-b35d-9f4e73044fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:06.515449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb8dce-5388-4ed9-b35d-9f4e73044fb5 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:06.515877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb8dce-5388-4ed9-b35d-9f4e73044fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:06.516290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb8dce-5388-4ed9-b35d-9f4e73044fb5 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:06.517360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb8dce-5388-4ed9-b35d-9f4e73044fb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:06.519611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb8dce-5388-4ed9-b35d-9f4e73044fb5 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:06.646728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 607/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 28 17:51:06 2022] POST /identity/v3/users => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 17:51:08.697919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b71d63-6201-46d6-9472-c9312d1b3a7f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:08.698501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b71d63-6201-46d6-9472-c9312d1b3a7f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:08.698501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b71d63-6201-46d6-9472-c9312d1b3a7f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:08.699874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 599/1206] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:08.705793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49171d79-e73a-4441-a7f1-e30092056580 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:08.706245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49171d79-e73a-4441-a7f1-e30092056580 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:08.706352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49171d79-e73a-4441-a7f1-e30092056580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:08.724197 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-49171d79-e73a-4441-a7f1-e30092056580 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:08.725417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-49171d79-e73a-4441-a7f1-e30092056580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:08.790156 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 608/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:08.813754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b71d63-6201-46d6-9472-c9312d1b3a7f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:08.914644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b71d63-6201-46d6-9472-c9312d1b3a7f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:08.947134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2a1a6-984f-41ae-b1bb-f70b5f60bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:08.947759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2a1a6-984f-41ae-b1bb-f70b5f60bda6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:08.948081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2a1a6-984f-41ae-b1bb-f70b5f60bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:08.948357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2a1a6-984f-41ae-b1bb-f70b5f60bda6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:08.959439 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2a1a6-984f-41ae-b1bb-f70b5f60bda6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ecc2a1a6-984f-41ae-b1bb-f70b5f60bda6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:51:08.964350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:08.965549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:08.966634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 600/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:08.972394 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49171d79-e73a-4441-a7f1-e30092056580 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:09.010976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:09.069149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49171d79-e73a-4441-a7f1-e30092056580 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:09.101972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa108-05ef-430e-8b5e-4b9404c739a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:09.102570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa108-05ef-430e-8b5e-4b9404c739a9 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:09.102847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa108-05ef-430e-8b5e-4b9404c739a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:09.103118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806aa108-05ef-430e-8b5e-4b9404c739a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:09.103820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa108-05ef-430e-8b5e-4b9404c739a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:09.104122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa108-05ef-430e-8b5e-4b9404c739a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:09.105506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806aa108-05ef-430e-8b5e-4b9404c739a9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:09.113248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 609/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:09.119054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2a1a6-984f-41ae-b1bb-f70b5f60bda6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:09.169289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:09.218088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2a1a6-984f-41ae-b1bb-f70b5f60bda6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:09.250597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc757-44a3-455a-9c30-8f74e5ba26f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:09.251235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc757-44a3-455a-9c30-8f74e5ba26f1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:09.251513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc757-44a3-455a-9c30-8f74e5ba26f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:09.251785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc757-44a3-455a-9c30-8f74e5ba26f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:09.261935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dc757-44a3-455a-9c30-8f74e5ba26f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:09.263382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dc757-44a3-455a-9c30-8f74e5ba26f1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-eb4dc757-44a3-455a-9c30-8f74e5ba26f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:09.277224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:09.278279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:09.279304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:09.279304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:09.279304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:09.279304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:09.279304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 601/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:09.284694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa108-05ef-430e-8b5e-4b9404c739a9 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:09.380756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:09.383616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806aa108-05ef-430e-8b5e-4b9404c739a9 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:09.415928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22049f1c-2b42-476f-bec1-7fd8100fb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:09.416531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22049f1c-2b42-476f-bec1-7fd8100fb24e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:09.416831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22049f1c-2b42-476f-bec1-7fd8100fb24e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:09.417107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22049f1c-2b42-476f-bec1-7fd8100fb24e None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:09.417785 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22049f1c-2b42-476f-bec1-7fd8100fb24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:09.418087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22049f1c-2b42-476f-bec1-7fd8100fb24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:09.419436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22049f1c-2b42-476f-bec1-7fd8100fb24e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:09.431143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 610/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:09.437119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc757-44a3-455a-9c30-8f74e5ba26f1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:09.535381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc757-44a3-455a-9c30-8f74e5ba26f1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:09.536868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:09.568294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc334-be23-4d68-a2bc-a808e33dfb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:09.568959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc334-be23-4d68-a2bc-a808e33dfb4f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:09.569240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc334-be23-4d68-a2bc-a808e33dfb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:09.569511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc334-be23-4d68-a2bc-a808e33dfb4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:09.576647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecc334-be23-4d68-a2bc-a808e33dfb4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:09.578130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecc334-be23-4d68-a2bc-a808e33dfb4f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-73ecc334-be23-4d68-a2bc-a808e33dfb4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:51:09.589027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:09.599385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:09.600556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 602/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:09.601336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22049f1c-2b42-476f-bec1-7fd8100fb24e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:09.701233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22049f1c-2b42-476f-bec1-7fd8100fb24e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:09.735548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62402f24-e662-497a-a40f-2783aa940a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:09.736211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62402f24-e662-497a-a40f-2783aa940a1e None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:09.736425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62402f24-e662-497a-a40f-2783aa940a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:09.736696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62402f24-e662-497a-a40f-2783aa940a1e None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:09.737512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62402f24-e662-497a-a40f-2783aa940a1e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:09.737820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62402f24-e662-497a-a40f-2783aa940a1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:09.739249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62402f24-e662-497a-a40f-2783aa940a1e None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:09.755692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 611/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 28 17:51:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:09.761608 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc334-be23-4d68-a2bc-a808e33dfb4f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:09.864216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc334-be23-4d68-a2bc-a808e33dfb4f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:09.899260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ef3b4-8e1d-498e-a432-23c845794b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:09.899862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef3b4-8e1d-498e-a432-23c845794b42 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:09.900134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef3b4-8e1d-498e-a432-23c845794b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:09.900401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef3b4-8e1d-498e-a432-23c845794b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:09.930570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:09.967057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ef3b4-8e1d-498e-a432-23c845794b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:09.968503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ef3b4-8e1d-498e-a432-23c845794b42 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:10.064724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 603/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:51:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:51:10.070902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62402f24-e662-497a-a40f-2783aa940a1e None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:10.089402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:10.167385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62402f24-e662-497a-a40f-2783aa940a1e None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:10.202396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ffd92-c6cb-45c1-b808-9793ba373ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:10.203031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ffd92-c6cb-45c1-b808-9793ba373ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:10.203312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ffd92-c6cb-45c1-b808-9793ba373ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:10.203586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ffd92-c6cb-45c1-b808-9793ba373ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:10.213530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ffd92-c6cb-45c1-b808-9793ba373ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:10.216616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ffd92-c6cb-45c1-b808-9793ba373ce1 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-e73ffd92-c6cb-45c1-b808-9793ba373ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:10.229634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:10.230694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:10.231809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:10.231809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:10.231809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:10.231809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:10.231809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 612/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:10.237141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ef3b4-8e1d-498e-a432-23c845794b42 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:10.296058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:10.333574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ef3b4-8e1d-498e-a432-23c845794b42 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:10.366357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bb2fb-c40b-4ed9-b1c3-b26d98a1a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:10.366970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bb2fb-c40b-4ed9-b1c3-b26d98a1a952 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:10.367252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bb2fb-c40b-4ed9-b1c3-b26d98a1a952 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:10.367527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bb2fb-c40b-4ed9-b1c3-b26d98a1a952 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:10.368211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bb2fb-c40b-4ed9-b1c3-b26d98a1a952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:10.368511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bb2fb-c40b-4ed9-b1c3-b26d98a1a952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:10.369896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bb2fb-c40b-4ed9-b1c3-b26d98a1a952 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:10.381274 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 604/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:10.387026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ffd92-c6cb-45c1-b808-9793ba373ce1 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:10.455632 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:10.485041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ffd92-c6cb-45c1-b808-9793ba373ce1 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:10.517229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7719f71-5fa1-4382-80cb-0466becf6b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:10.517853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7719f71-5fa1-4382-80cb-0466becf6b27 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:10.518129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7719f71-5fa1-4382-80cb-0466becf6b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:10.518396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7719f71-5fa1-4382-80cb-0466becf6b27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:10.524863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7719f71-5fa1-4382-80cb-0466becf6b27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:10.526338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7719f71-5fa1-4382-80cb-0466becf6b27 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-a7719f71-5fa1-4382-80cb-0466becf6b27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:51:10.537242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:10.538218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:10.539267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:51:10.539267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:51:10.539267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:51:10.539267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:51:10.539267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:51:10.539267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:51:10.539267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:10.539267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:10.539267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 613/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:10.544102 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bb2fb-c40b-4ed9-b1c3-b26d98a1a952 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:10.648408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bb2fb-c40b-4ed9-b1c3-b26d98a1a952 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:10.670492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:10.681364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95031c51-676d-4add-a646-f4b4d7206512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:10.681977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95031c51-676d-4add-a646-f4b4d7206512 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:10.682255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95031c51-676d-4add-a646-f4b4d7206512 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:10.682527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95031c51-676d-4add-a646-f4b4d7206512 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:10.683267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95031c51-676d-4add-a646-f4b4d7206512 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:10.683571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95031c51-676d-4add-a646-f4b4d7206512 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:10.685021 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95031c51-676d-4add-a646-f4b4d7206512 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:10.696755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 605/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:10.703430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7719f71-5fa1-4382-80cb-0466becf6b27 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:10.800399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7719f71-5fa1-4382-80cb-0466becf6b27 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:10.827623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:10.833489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39de29b-a240-4c4e-afb2-3e218262eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:10.834093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39de29b-a240-4c4e-afb2-3e218262eeed None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:10.834377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39de29b-a240-4c4e-afb2-3e218262eeed None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:10.834704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39de29b-a240-4c4e-afb2-3e218262eeed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:10.835496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39de29b-a240-4c4e-afb2-3e218262eeed None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=4dded05b23a0469785e3a7bedf1cf851) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:10.835897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39de29b-a240-4c4e-afb2-3e218262eeed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:10.837419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39de29b-a240-4c4e-afb2-3e218262eeed None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:10.843463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 614/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:51:10 2022] GET /identity/v3/role_assignments?user.id=4dded05b23a0469785e3a7bedf1cf851&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:51:12.820844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9971-a1e6-4b98-a7f6-d355fed95f4b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:12.821473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9971-a1e6-4b98-a7f6-d355fed95f4b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:12.821473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9971-a1e6-4b98-a7f6-d355fed95f4b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:12.822781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 606/1220] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:12.829013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5544d6b-740b-4b99-b218-4bb2054ce5ea None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:12.829459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5544d6b-740b-4b99-b218-4bb2054ce5ea None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:12.829563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5544d6b-740b-4b99-b218-4bb2054ce5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:12.847740 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f5544d6b-740b-4b99-b218-4bb2054ce5ea None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:12.848950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f5544d6b-740b-4b99-b218-4bb2054ce5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:12.918482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 615/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 17:51:12.941603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9971-a1e6-4b98-a7f6-d355fed95f4b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:13.041583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9971-a1e6-4b98-a7f6-d355fed95f4b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:13.075067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82ff3c-1599-49fd-9277-54e863f6bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:13.075630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82ff3c-1599-49fd-9277-54e863f6bea5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:13.075906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82ff3c-1599-49fd-9277-54e863f6bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:13.076175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82ff3c-1599-49fd-9277-54e863f6bea5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:13.087054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82ff3c-1599-49fd-9277-54e863f6bea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2a82ff3c-1599-49fd-9277-54e863f6bea5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:51:13.092007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:13.096899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:13.098022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 607/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:51:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:13.099345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5544d6b-740b-4b99-b218-4bb2054ce5ea None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:13.197984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5544d6b-740b-4b99-b218-4bb2054ce5ea None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:13.221269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:13.231521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ebde3-f2ce-4175-803b-74ea5395f137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:13.233747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ebde3-f2ce-4175-803b-74ea5395f137 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:13.233747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ebde3-f2ce-4175-803b-74ea5395f137 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:13.233747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ebde3-f2ce-4175-803b-74ea5395f137 None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:13.233747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ebde3-f2ce-4175-803b-74ea5395f137 None admin] RBAC: Adding query filter params (name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:13.233747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ebde3-f2ce-4175-803b-74ea5395f137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:13.235119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ebde3-f2ce-4175-803b-74ea5395f137 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:13.242744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 616/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:51:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:13.248516 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82ff3c-1599-49fd-9277-54e863f6bea5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:13.293212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:13.348371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82ff3c-1599-49fd-9277-54e863f6bea5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:13.381790 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adaf7f-ce82-416f-bdad-428351a8cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:13.382437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adaf7f-ce82-416f-bdad-428351a8cf68 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:13.382950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adaf7f-ce82-416f-bdad-428351a8cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:13.383279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adaf7f-ce82-416f-bdad-428351a8cf68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:13.394300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adaf7f-ce82-416f-bdad-428351a8cf68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:13.395747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adaf7f-ce82-416f-bdad-428351a8cf68 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-46adaf7f-ce82-416f-bdad-428351a8cf68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:13.410705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:13.412225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:13.413362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:13.413362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:13.413362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:13.413362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:13.413362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 608/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:13.417731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ebde3-f2ce-4175-803b-74ea5395f137 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:13.518891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ebde3-f2ce-4175-803b-74ea5395f137 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:13.553348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329f14c-6387-4a94-9112-14b4dd7162cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:13.553956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329f14c-6387-4a94-9112-14b4dd7162cc None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:13.554233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329f14c-6387-4a94-9112-14b4dd7162cc None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:13.554502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329f14c-6387-4a94-9112-14b4dd7162cc None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:13.555181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329f14c-6387-4a94-9112-14b4dd7162cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:13.555480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329f14c-6387-4a94-9112-14b4dd7162cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:13.556856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329f14c-6387-4a94-9112-14b4dd7162cc None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:13.568671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 617/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:13.575529 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adaf7f-ce82-416f-bdad-428351a8cf68 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:13.667352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:13.673842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adaf7f-ce82-416f-bdad-428351a8cf68 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:13.709812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be356de-3c1a-447b-a403-bb8ae82767e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:13.710458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be356de-3c1a-447b-a403-bb8ae82767e0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:13.710732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be356de-3c1a-447b-a403-bb8ae82767e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:13.711002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be356de-3c1a-447b-a403-bb8ae82767e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:13.719554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be356de-3c1a-447b-a403-bb8ae82767e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:13.721061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be356de-3c1a-447b-a403-bb8ae82767e0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4be356de-3c1a-447b-a403-bb8ae82767e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:51:13.732724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:13.733960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:13.735361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 609/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:13.739993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329f14c-6387-4a94-9112-14b4dd7162cc None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:13.787050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:13.839457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329f14c-6387-4a94-9112-14b4dd7162cc None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:13.872837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044a168-2cc9-48b0-a31c-e94a3dc99fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:13.873449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044a168-2cc9-48b0-a31c-e94a3dc99fbe None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:13.874259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044a168-2cc9-48b0-a31c-e94a3dc99fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:13.874537 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044a168-2cc9-48b0-a31c-e94a3dc99fbe None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:13.875325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044a168-2cc9-48b0-a31c-e94a3dc99fbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:13.875629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044a168-2cc9-48b0-a31c-e94a3dc99fbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:13.877078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044a168-2cc9-48b0-a31c-e94a3dc99fbe None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:13.898978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 618/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 28 17:51:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:13.903129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be356de-3c1a-447b-a403-bb8ae82767e0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:14.006754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be356de-3c1a-447b-a403-bb8ae82767e0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:14.040043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03e6e-f049-48f9-8f44-45a49e6526b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:14.040681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03e6e-f049-48f9-8f44-45a49e6526b2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:14.040988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03e6e-f049-48f9-8f44-45a49e6526b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:14.041263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03e6e-f049-48f9-8f44-45a49e6526b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:14.051609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff03e6e-f049-48f9-8f44-45a49e6526b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:14.053140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff03e6e-f049-48f9-8f44-45a49e6526b2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bff03e6e-f049-48f9-8f44-45a49e6526b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:14.067874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:14.068999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:14.070116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:14.070116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:14.070116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:14.070116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:14.070116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 610/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:14.075189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044a168-2cc9-48b0-a31c-e94a3dc99fbe None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:14.175402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044a168-2cc9-48b0-a31c-e94a3dc99fbe None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:14.177830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:14.209592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76710f5-f440-485d-b760-f99c2f6ad004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:14.210207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76710f5-f440-485d-b760-f99c2f6ad004 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:14.210487 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76710f5-f440-485d-b760-f99c2f6ad004 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:14.210760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76710f5-f440-485d-b760-f99c2f6ad004 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:14.211443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76710f5-f440-485d-b760-f99c2f6ad004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:14.211746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76710f5-f440-485d-b760-f99c2f6ad004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:14.213137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76710f5-f440-485d-b760-f99c2f6ad004 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:14.224079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 619/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:14.230041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03e6e-f049-48f9-8f44-45a49e6526b2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:14.239821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:14.330002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03e6e-f049-48f9-8f44-45a49e6526b2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:14.363620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4febd5-f222-4378-9b62-28f71fe3f97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:14.364270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4febd5-f222-4378-9b62-28f71fe3f97a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:14.364554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4febd5-f222-4378-9b62-28f71fe3f97a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:14.364856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4febd5-f222-4378-9b62-28f71fe3f97a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:14.372020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4febd5-f222-4378-9b62-28f71fe3f97a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:14.374653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4febd5-f222-4378-9b62-28f71fe3f97a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-fb4febd5-f222-4378-9b62-28f71fe3f97a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:51:14.385960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:14.387024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:14.388174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:51:14.388174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:51:14.388174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:51:14.388174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:51:14.388174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:51:14.388174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:51:14.388174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:14.388174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:14.388174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 611/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:14.392971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76710f5-f440-485d-b760-f99c2f6ad004 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:14.494859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76710f5-f440-485d-b760-f99c2f6ad004 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:14.528539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10d75e-dd54-45b1-be5a-13e648dffdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:14.529177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10d75e-dd54-45b1-be5a-13e648dffdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:14.529458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10d75e-dd54-45b1-be5a-13e648dffdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:14.529730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10d75e-dd54-45b1-be5a-13e648dffdd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:14.530966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10d75e-dd54-45b1-be5a-13e648dffdd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:14.531397 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10d75e-dd54-45b1-be5a-13e648dffdd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:14.532830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10d75e-dd54-45b1-be5a-13e648dffdd3 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:14.545030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 620/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:14.551728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4febd5-f222-4378-9b62-28f71fe3f97a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:14.618795 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:14.652017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4febd5-f222-4378-9b62-28f71fe3f97a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:14.685642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f4d40-5eeb-4f0f-9826-764401c90317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:14.689445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4d40-5eeb-4f0f-9826-764401c90317 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:14.689445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4d40-5eeb-4f0f-9826-764401c90317 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:14.689445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4d40-5eeb-4f0f-9826-764401c90317 None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/4dded05b23a0469785e3a7bedf1cf851/roles/467b18ae24a4482592d2b45bc717c5eb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:14.701425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f4d40-5eeb-4f0f-9826-764401c90317 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=4dded05b23a0469785e3a7bedf1cf851, role_id=467b18ae24a4482592d2b45bc717c5eb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:14.702854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f4d40-5eeb-4f0f-9826-764401c90317 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:14.789133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 612/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:51:14 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/4dded05b23a0469785e3a7bedf1cf851/roles/467b18ae24a4482592d2b45bc717c5eb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 17:51:16.792798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a23501-399c-4ba2-a815-2fe0fffd239c None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:16.793381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a23501-399c-4ba2-a815-2fe0fffd239c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:16.793381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a23501-399c-4ba2-a815-2fe0fffd239c None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:16.794691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 621/1233] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:16.800409 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570f6e-0dd3-40f4-af06-23a64a729c7a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:16.800819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570f6e-0dd3-40f4-af06-23a64a729c7a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:16.800988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570f6e-0dd3-40f4-af06-23a64a729c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:16.818894 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f0570f6e-0dd3-40f4-af06-23a64a729c7a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:16.820072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f0570f6e-0dd3-40f4-af06-23a64a729c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:16.890821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 613/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:16.914194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a23501-399c-4ba2-a815-2fe0fffd239c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:16.939974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:17.025353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a23501-399c-4ba2-a815-2fe0fffd239c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:17.060075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf86b0-b852-44f9-8337-92fab6028216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:17.060640 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf86b0-b852-44f9-8337-92fab6028216 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:17.060948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf86b0-b852-44f9-8337-92fab6028216 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:17.061222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf86b0-b852-44f9-8337-92fab6028216 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:17.071512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf86b0-b852-44f9-8337-92fab6028216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-aedf86b0-b852-44f9-8337-92fab6028216 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:51:17.076393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:17.077614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:17.078486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 622/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 28 17:51:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:17.083769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570f6e-0dd3-40f4-af06-23a64a729c7a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:17.130905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:17.182914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570f6e-0dd3-40f4-af06-23a64a729c7a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:17.216921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806f6a-a73e-4d5c-adda-558bab121f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:17.217583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806f6a-a73e-4d5c-adda-558bab121f91 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:17.217863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806f6a-a73e-4d5c-adda-558bab121f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:17.218135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c806f6a-a73e-4d5c-adda-558bab121f91 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:17.218914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806f6a-a73e-4d5c-adda-558bab121f91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:17.219221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806f6a-a73e-4d5c-adda-558bab121f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:17.220580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c806f6a-a73e-4d5c-adda-558bab121f91 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:17.228220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 614/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 28 17:51:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:17.234442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf86b0-b852-44f9-8337-92fab6028216 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:17.318464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:17.333907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf86b0-b852-44f9-8337-92fab6028216 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:17.367141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58976099-2ffb-4987-8521-f5a813588a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:17.367771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58976099-2ffb-4987-8521-f5a813588a93 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:17.368052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58976099-2ffb-4987-8521-f5a813588a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:17.368325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58976099-2ffb-4987-8521-f5a813588a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:17.378646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58976099-2ffb-4987-8521-f5a813588a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:17.383390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58976099-2ffb-4987-8521-f5a813588a93 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-58976099-2ffb-4987-8521-f5a813588a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:17.394344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:17.395373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:17.396539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:17.396539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:17.396539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:17.396539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:17.396539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 623/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:17.401410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806f6a-a73e-4d5c-adda-558bab121f91 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:17.501805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c806f6a-a73e-4d5c-adda-558bab121f91 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:17.510600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:17.535499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3607e-b95b-46ba-9d3a-4da68de7a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:17.536115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3607e-b95b-46ba-9d3a-4da68de7a23f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:17.536394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3607e-b95b-46ba-9d3a-4da68de7a23f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:17.536668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3607e-b95b-46ba-9d3a-4da68de7a23f None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:17.537420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3607e-b95b-46ba-9d3a-4da68de7a23f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:17.537724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3607e-b95b-46ba-9d3a-4da68de7a23f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:17.539084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3607e-b95b-46ba-9d3a-4da68de7a23f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:17.551357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 615/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:17.557020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58976099-2ffb-4987-8521-f5a813588a93 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:17.659164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58976099-2ffb-4987-8521-f5a813588a93 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:17.692648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31585083-9b1e-45b9-bd5b-1d8d08fb2455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:17.693307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31585083-9b1e-45b9-bd5b-1d8d08fb2455 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:17.693750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31585083-9b1e-45b9-bd5b-1d8d08fb2455 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:17.693876 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31585083-9b1e-45b9-bd5b-1d8d08fb2455 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:17.696526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:17.701407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31585083-9b1e-45b9-bd5b-1d8d08fb2455 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:17.702837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31585083-9b1e-45b9-bd5b-1d8d08fb2455 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-31585083-9b1e-45b9-bd5b-1d8d08fb2455 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:51:17.713698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:17.714635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:17.715723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 624/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:17.721292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3607e-b95b-46ba-9d3a-4da68de7a23f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:17.823510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3607e-b95b-46ba-9d3a-4da68de7a23f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:17.857094 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed0326-9a3f-419d-ba1f-60084a019a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:17.857707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed0326-9a3f-419d-ba1f-60084a019a69 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:17.858002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed0326-9a3f-419d-ba1f-60084a019a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:17.858838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed0326-9a3f-419d-ba1f-60084a019a69 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:17.859627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed0326-9a3f-419d-ba1f-60084a019a69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:17.859932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed0326-9a3f-419d-ba1f-60084a019a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:17.861379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed0326-9a3f-419d-ba1f-60084a019a69 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:17.883240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 616/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 28 17:51:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:17.889188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31585083-9b1e-45b9-bd5b-1d8d08fb2455 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:18.005745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31585083-9b1e-45b9-bd5b-1d8d08fb2455 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:18.045723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928169-ef11-4287-a01c-ec83bd89170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:18.046328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928169-ef11-4287-a01c-ec83bd89170d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:18.046611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928169-ef11-4287-a01c-ec83bd89170d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:18.046879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928169-ef11-4287-a01c-ec83bd89170d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:18.111292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:18.118753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928169-ef11-4287-a01c-ec83bd89170d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:18.120397 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928169-ef11-4287-a01c-ec83bd89170d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:18.219077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 625/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:51:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:51:18.225093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed0326-9a3f-419d-ba1f-60084a019a69 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:18.253477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:18.322407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed0326-9a3f-419d-ba1f-60084a019a69 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:18.356943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da9386-52ad-41ee-be8e-2982b40ef5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:18.357586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9386-52ad-41ee-be8e-2982b40ef5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:18.357868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9386-52ad-41ee-be8e-2982b40ef5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:18.358139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9386-52ad-41ee-be8e-2982b40ef5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:18.368027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da9386-52ad-41ee-be8e-2982b40ef5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:18.369513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da9386-52ad-41ee-be8e-2982b40ef5a7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d7da9386-52ad-41ee-be8e-2982b40ef5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:18.384263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:18.385386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:18.386369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:18.386369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:18.386369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:18.386369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:18.386369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 617/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:18.391826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928169-ef11-4287-a01c-ec83bd89170d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:18.484359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:18.490067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928169-ef11-4287-a01c-ec83bd89170d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:18.523010 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7bbe-0b46-4695-9327-f09b09ed2060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:18.523618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7bbe-0b46-4695-9327-f09b09ed2060 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:18.523898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7bbe-0b46-4695-9327-f09b09ed2060 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:18.524172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a7bbe-0b46-4695-9327-f09b09ed2060 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:18.524885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7bbe-0b46-4695-9327-f09b09ed2060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:18.525191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7bbe-0b46-4695-9327-f09b09ed2060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:18.526609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a7bbe-0b46-4695-9327-f09b09ed2060 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:18.538027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 626/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:18.543743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da9386-52ad-41ee-be8e-2982b40ef5a7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:18.622373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:18.643208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da9386-52ad-41ee-be8e-2982b40ef5a7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:18.675554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd1dd8-acbc-46b8-a86c-d2cd1b5f9e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:18.676182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd1dd8-acbc-46b8-a86c-d2cd1b5f9e5b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:18.676462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd1dd8-acbc-46b8-a86c-d2cd1b5f9e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:18.676735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd1dd8-acbc-46b8-a86c-d2cd1b5f9e5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:18.683200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd1dd8-acbc-46b8-a86c-d2cd1b5f9e5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:18.684625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd1dd8-acbc-46b8-a86c-d2cd1b5f9e5b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-aebd1dd8-acbc-46b8-a86c-d2cd1b5f9e5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:51:18.697985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:18.699085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:18.700204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:51:18.700204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:51:18.700204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:51:18.700204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:51:18.700204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:51:18.700204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:51:18.700204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:18.700204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:18.700204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 618/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:18.705557 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7bbe-0b46-4695-9327-f09b09ed2060 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:18.804801 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a7bbe-0b46-4695-9327-f09b09ed2060 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:18.838186 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02e90-251e-4e1c-a08d-c6b5c6a32c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:18.838790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02e90-251e-4e1c-a08d-c6b5c6a32c6d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:18.839079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02e90-251e-4e1c-a08d-c6b5c6a32c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:18.839353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02e90-251e-4e1c-a08d-c6b5c6a32c6d None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:18.840094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02e90-251e-4e1c-a08d-c6b5c6a32c6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:18.840401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02e90-251e-4e1c-a08d-c6b5c6a32c6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:18.841855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02e90-251e-4e1c-a08d-c6b5c6a32c6d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:18.854177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 627/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:18.861001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd1dd8-acbc-46b8-a86c-d2cd1b5f9e5b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:18.960793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd1dd8-acbc-46b8-a86c-d2cd1b5f9e5b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:18.993705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec6ee8-7745-494a-9ead-21f661627d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:18.994312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec6ee8-7745-494a-9ead-21f661627d5a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:18.994593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec6ee8-7745-494a-9ead-21f661627d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:18.994865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec6ee8-7745-494a-9ead-21f661627d5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:18.995642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec6ee8-7745-494a-9ead-21f661627d5a None admin] RBAC: Adding query filter params (role.id=467b18ae24a4482592d2b45bc717c5eb, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=4dded05b23a0469785e3a7bedf1cf851) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:18.995952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec6ee8-7745-494a-9ead-21f661627d5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:18.997417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec6ee8-7745-494a-9ead-21f661627d5a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:19.003680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 619/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:51:18 2022] GET /identity/v3/role_assignments?user.id=4dded05b23a0469785e3a7bedf1cf851&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=467b18ae24a4482592d2b45bc717c5eb => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:21.111051 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f454-096a-450a-b697-ae90ccac3f30 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:21.111583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f454-096a-450a-b697-ae90ccac3f30 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:21.111583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f454-096a-450a-b697-ae90ccac3f30 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:21.113040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 628/1247] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:21.118728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34757bfe-8a0e-4589-925c-10349d3ac74e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:21.119160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34757bfe-8a0e-4589-925c-10349d3ac74e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:21.119417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34757bfe-8a0e-4589-925c-10349d3ac74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:21.126480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:21.138709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-34757bfe-8a0e-4589-925c-10349d3ac74e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:21.140453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-34757bfe-8a0e-4589-925c-10349d3ac74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:21.207580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 620/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:21.232170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60f454-096a-450a-b697-ae90ccac3f30 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:21.251331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:21.333458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60f454-096a-450a-b697-ae90ccac3f30 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:21.368343 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0c30a-f3ee-41df-8349-cd742a146940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:21.368937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c30a-f3ee-41df-8349-cd742a146940 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:21.369217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c30a-f3ee-41df-8349-cd742a146940 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:21.369489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c30a-f3ee-41df-8349-cd742a146940 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:21.380175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0c30a-f3ee-41df-8349-cd742a146940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-28e0c30a-f3ee-41df-8349-cd742a146940 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:51:21.385094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:21.386134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:21.387015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 629/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:21.392744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34757bfe-8a0e-4589-925c-10349d3ac74e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:21.493411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34757bfe-8a0e-4589-925c-10349d3ac74e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:21.521886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:21.526892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ca631-b84e-4481-bbf9-a69488f1dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:21.527502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ca631-b84e-4481-bbf9-a69488f1dc35 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:21.527782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ca631-b84e-4481-bbf9-a69488f1dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:21.528052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ca631-b84e-4481-bbf9-a69488f1dc35 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:21.528757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ca631-b84e-4481-bbf9-a69488f1dc35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:21.529093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ca631-b84e-4481-bbf9-a69488f1dc35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:21.530968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ca631-b84e-4481-bbf9-a69488f1dc35 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:21.539663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 621/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:51:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:21.546063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0c30a-f3ee-41df-8349-cd742a146940 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:21.624069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:21.646169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0c30a-f3ee-41df-8349-cd742a146940 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:21.678575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612bb10-e798-4980-8484-518b0f836901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:21.679199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612bb10-e798-4980-8484-518b0f836901 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:21.679473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612bb10-e798-4980-8484-518b0f836901 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:21.679742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612bb10-e798-4980-8484-518b0f836901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:21.691036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612bb10-e798-4980-8484-518b0f836901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:21.692525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612bb10-e798-4980-8484-518b0f836901 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-5612bb10-e798-4980-8484-518b0f836901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:21.706400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:21.707450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:21.708554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:21.708554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:21.708554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:21.708554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:21.708554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 630/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:21.713325 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ca631-b84e-4481-bbf9-a69488f1dc35 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:21.814489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ca631-b84e-4481-bbf9-a69488f1dc35 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:21.848064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064daa32-6fb9-45f4-b408-b2a1edcdcf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:21.848680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064daa32-6fb9-45f4-b408-b2a1edcdcf39 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:21.848996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064daa32-6fb9-45f4-b408-b2a1edcdcf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:21.849275 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064daa32-6fb9-45f4-b408-b2a1edcdcf39 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:21.849956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064daa32-6fb9-45f4-b408-b2a1edcdcf39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:21.850260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064daa32-6fb9-45f4-b408-b2a1edcdcf39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:21.851656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064daa32-6fb9-45f4-b408-b2a1edcdcf39 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:21.863668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 622/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:21.869402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612bb10-e798-4980-8484-518b0f836901 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:21.971688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612bb10-e798-4980-8484-518b0f836901 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:21.998214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:22.007266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad152de-9d36-44ac-b506-18cc07a4ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:22.007903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad152de-9d36-44ac-b506-18cc07a4ab53 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:22.008179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad152de-9d36-44ac-b506-18cc07a4ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:22.008448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad152de-9d36-44ac-b506-18cc07a4ab53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:22.016041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad152de-9d36-44ac-b506-18cc07a4ab53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:22.020126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad152de-9d36-44ac-b506-18cc07a4ab53 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-2ad152de-9d36-44ac-b506-18cc07a4ab53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:51:22.028728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:22.030425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:22.031855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 631/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:22.036287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064daa32-6fb9-45f4-b408-b2a1edcdcf39 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:22.090143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:22.134088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064daa32-6fb9-45f4-b408-b2a1edcdcf39 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:22.167317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebd8af-f4ac-4d1d-9493-7dcffb68a6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:22.167948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebd8af-f4ac-4d1d-9493-7dcffb68a6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:22.168231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebd8af-f4ac-4d1d-9493-7dcffb68a6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:22.168507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebd8af-f4ac-4d1d-9493-7dcffb68a6a6 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:22.169333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebd8af-f4ac-4d1d-9493-7dcffb68a6a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:22.169655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebd8af-f4ac-4d1d-9493-7dcffb68a6a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:22.171602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebd8af-f4ac-4d1d-9493-7dcffb68a6a6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:22.189060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 623/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 28 17:51:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 17:51:22.195095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad152de-9d36-44ac-b506-18cc07a4ab53 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:22.294658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad152de-9d36-44ac-b506-18cc07a4ab53 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:22.330168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7950e-72b6-4b83-96a5-3573790c0681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:22.330749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7950e-72b6-4b83-96a5-3573790c0681 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:22.331028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7950e-72b6-4b83-96a5-3573790c0681 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:22.331298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7950e-72b6-4b83-96a5-3573790c0681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:22.385210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:22.398022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7950e-72b6-4b83-96a5-3573790c0681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:22.399469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7950e-72b6-4b83-96a5-3573790c0681 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:22.495867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 632/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:51:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:51:22.502159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebd8af-f4ac-4d1d-9493-7dcffb68a6a6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:22.599942 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebd8af-f4ac-4d1d-9493-7dcffb68a6a6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:22.613111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:22.633142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327909-0d73-4eee-aabe-ee4b1b92d68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:22.633771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327909-0d73-4eee-aabe-ee4b1b92d68b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:22.640054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327909-0d73-4eee-aabe-ee4b1b92d68b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:22.640054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327909-0d73-4eee-aabe-ee4b1b92d68b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:22.644179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327909-0d73-4eee-aabe-ee4b1b92d68b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:22.645701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327909-0d73-4eee-aabe-ee4b1b92d68b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-cd327909-0d73-4eee-aabe-ee4b1b92d68b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:22.659880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:22.661020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:22.662176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:22.662176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:22.662176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:22.662176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:22.662176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 624/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:22.666982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7950e-72b6-4b83-96a5-3573790c0681 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:22.756654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:22.768664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7950e-72b6-4b83-96a5-3573790c0681 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:22.802428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1f1bc-d2c4-4b10-aabe-cd81622594b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:22.803039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f1bc-d2c4-4b10-aabe-cd81622594b4 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:22.803318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f1bc-d2c4-4b10-aabe-cd81622594b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:22.803592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f1bc-d2c4-4b10-aabe-cd81622594b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:22.804274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1f1bc-d2c4-4b10-aabe-cd81622594b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:22.804577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1f1bc-d2c4-4b10-aabe-cd81622594b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:22.806045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1f1bc-d2c4-4b10-aabe-cd81622594b4 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:22.817404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 633/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:22.823157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327909-0d73-4eee-aabe-ee4b1b92d68b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:22.922743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327909-0d73-4eee-aabe-ee4b1b92d68b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:22.956959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac50cb8-5ca7-46cc-8765-20af4b0eb944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:22.957599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac50cb8-5ca7-46cc-8765-20af4b0eb944 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:22.957879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac50cb8-5ca7-46cc-8765-20af4b0eb944 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:22.958153 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac50cb8-5ca7-46cc-8765-20af4b0eb944 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:22.964797 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac50cb8-5ca7-46cc-8765-20af4b0eb944 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:22.966311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac50cb8-5ca7-46cc-8765-20af4b0eb944 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0ac50cb8-5ca7-46cc-8765-20af4b0eb944 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:51:22.978880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:22.979906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:22.981192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:51:22.981192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:51:22.981192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:51:22.981192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:51:22.981192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:51:22.981192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:51:22.981192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:22.981192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:22.981192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 625/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:22.986531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1f1bc-d2c4-4b10-aabe-cd81622594b4 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:23.087146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1f1bc-d2c4-4b10-aabe-cd81622594b4 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:23.121346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4135d-ee70-47ee-8e20-1dc10ccdfffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:23.121958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4135d-ee70-47ee-8e20-1dc10ccdfffd None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:23.122234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4135d-ee70-47ee-8e20-1dc10ccdfffd None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:23.122503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4135d-ee70-47ee-8e20-1dc10ccdfffd None admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:23.123253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4135d-ee70-47ee-8e20-1dc10ccdfffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:23.123770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4135d-ee70-47ee-8e20-1dc10ccdfffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:23.125033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4135d-ee70-47ee-8e20-1dc10ccdfffd None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:23.136797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 634/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:23.143722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac50cb8-5ca7-46cc-8765-20af4b0eb944 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:23.169945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:23.241801 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac50cb8-5ca7-46cc-8765-20af4b0eb944 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:23.274355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe9852-22d9-4cc6-9789-4feb324e5532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:23.274966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9852-22d9-4cc6-9789-4feb324e5532 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:23.275246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9852-22d9-4cc6-9789-4feb324e5532 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:23.275520 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe9852-22d9-4cc6-9789-4feb324e5532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:23.276301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9852-22d9-4cc6-9789-4feb324e5532 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=4dded05b23a0469785e3a7bedf1cf851) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:23.276609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9852-22d9-4cc6-9789-4feb324e5532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:23.278130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe9852-22d9-4cc6-9789-4feb324e5532 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:23.283468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 626/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:51:23 2022] GET /identity/v3/role_assignments?user.id=4dded05b23a0469785e3a7bedf1cf851&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:25.311610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0053-a9ba-4df2-b8bf-647ebfc6bb48 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:25.312142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0053-a9ba-4df2-b8bf-647ebfc6bb48 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:25.312142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0053-a9ba-4df2-b8bf-647ebfc6bb48 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:25.313527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 635/1261] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:25.319135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6f00e-7c55-4400-9e88-ce8be7c46866 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:25.319536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6f00e-7c55-4400-9e88-ce8be7c46866 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:25.319732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6f00e-7c55-4400-9e88-ce8be7c46866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:25.338286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f8b6f00e-7c55-4400-9e88-ce8be7c46866 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:25.339691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f8b6f00e-7c55-4400-9e88-ce8be7c46866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:25.409617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 627/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:25.432698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0053-a9ba-4df2-b8bf-647ebfc6bb48 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:25.444373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:25.537627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0053-a9ba-4df2-b8bf-647ebfc6bb48 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:25.572575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4b18-e6b0-48e8-9b7d-269feb4171ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:25.573236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4b18-e6b0-48e8-9b7d-269feb4171ed None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:25.573516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4b18-e6b0-48e8-9b7d-269feb4171ed None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:25.573785 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4b18-e6b0-48e8-9b7d-269feb4171ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:25.583646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4b18-e6b0-48e8-9b7d-269feb4171ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-a2ed4b18-e6b0-48e8-9b7d-269feb4171ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:51:25.588525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:25.589704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:25.590747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 636/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:51:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:25.595752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6f00e-7c55-4400-9e88-ce8be7c46866 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:25.615241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:25.693782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6f00e-7c55-4400-9e88-ce8be7c46866 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:25.726104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabab2b-866c-41bc-9ff7-4992616b82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:25.726716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabab2b-866c-41bc-9ff7-4992616b82e5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:25.727208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabab2b-866c-41bc-9ff7-4992616b82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:25.728118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabab2b-866c-41bc-9ff7-4992616b82e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:25.728884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabab2b-866c-41bc-9ff7-4992616b82e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:25.729232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabab2b-866c-41bc-9ff7-4992616b82e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:25.730664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabab2b-866c-41bc-9ff7-4992616b82e5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:25.739170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 628/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:51:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:25.744997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4b18-e6b0-48e8-9b7d-269feb4171ed None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:25.811993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:25.844993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4b18-e6b0-48e8-9b7d-269feb4171ed None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:25.882322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3cadb-a6c2-4f1c-95c7-cb6c51e8732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:25.882957 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3cadb-a6c2-4f1c-95c7-cb6c51e8732b None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:25.883240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3cadb-a6c2-4f1c-95c7-cb6c51e8732b None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:25.883516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3cadb-a6c2-4f1c-95c7-cb6c51e8732b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:25.893215 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3cadb-a6c2-4f1c-95c7-cb6c51e8732b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:25.894658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3cadb-a6c2-4f1c-95c7-cb6c51e8732b None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-5ad3cadb-a6c2-4f1c-95c7-cb6c51e8732b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:25.909425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:25.910609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:25.911799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:25.911799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:25.911799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:25.911799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:25.911799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 637/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:25.916476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabab2b-866c-41bc-9ff7-4992616b82e5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:25.996591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:26.016229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabab2b-866c-41bc-9ff7-4992616b82e5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:26.051663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430c59-85c1-46a0-9c37-6eb6e5c47ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:26.052280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430c59-85c1-46a0-9c37-6eb6e5c47ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:26.052559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430c59-85c1-46a0-9c37-6eb6e5c47ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:26.052863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430c59-85c1-46a0-9c37-6eb6e5c47ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:26.053552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430c59-85c1-46a0-9c37-6eb6e5c47ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:26.053855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430c59-85c1-46a0-9c37-6eb6e5c47ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:26.055211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430c59-85c1-46a0-9c37-6eb6e5c47ed1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:26.068059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 629/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:26.073832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3cadb-a6c2-4f1c-95c7-cb6c51e8732b None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:26.173902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3cadb-a6c2-4f1c-95c7-cb6c51e8732b None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:26.194551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:26.207858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f47d3c-bd80-444d-94f0-da1ba1bf0bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:26.208492 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f47d3c-bd80-444d-94f0-da1ba1bf0bef None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:26.208769 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f47d3c-bd80-444d-94f0-da1ba1bf0bef None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:26.209255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f47d3c-bd80-444d-94f0-da1ba1bf0bef None admin] PATH_INFO: `/v3/users/placement` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:26.216370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f47d3c-bd80-444d-94f0-da1ba1bf0bef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:26.224626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f47d3c-bd80-444d-94f0-da1ba1bf0bef None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-07f47d3c-bd80-444d-94f0-da1ba1bf0bef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:51:26.228690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:26.229828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:26.230788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:26.235178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 638/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:26.236138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430c59-85c1-46a0-9c37-6eb6e5c47ed1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:26.335879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430c59-85c1-46a0-9c37-6eb6e5c47ed1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:26.370275 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d2187-7da7-4638-858e-cc17cd688d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:26.370887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d2187-7da7-4638-858e-cc17cd688d78 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:26.371166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d2187-7da7-4638-858e-cc17cd688d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:26.371437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d2187-7da7-4638-858e-cc17cd688d78 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:26.372216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d2187-7da7-4638-858e-cc17cd688d78 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:26.372519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d2187-7da7-4638-858e-cc17cd688d78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:26.374047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d2187-7da7-4638-858e-cc17cd688d78 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:26.382572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:26.392001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 630/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 28 17:51:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:26.397688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f47d3c-bd80-444d-94f0-da1ba1bf0bef None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:26.497733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f47d3c-bd80-444d-94f0-da1ba1bf0bef None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:26.531337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebcaa-5263-4a0c-b4da-605626279435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:26.531971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebcaa-5263-4a0c-b4da-605626279435 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:26.532249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebcaa-5263-4a0c-b4da-605626279435 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:26.532523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebcaa-5263-4a0c-b4da-605626279435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:26.547468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ebcaa-5263-4a0c-b4da-605626279435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:26.548937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ebcaa-5263-4a0c-b4da-605626279435 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-2c9ebcaa-5263-4a0c-b4da-605626279435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:26.563090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:26.564167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:26.565505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:26.565505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:26.565505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:26.565505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:26.565505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 639/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:26.570547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d2187-7da7-4638-858e-cc17cd688d78 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:26.665913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d2187-7da7-4638-858e-cc17cd688d78 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:26.699121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba27d2a-747e-4987-94a1-785d478e6ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:26.699737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba27d2a-747e-4987-94a1-785d478e6ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:26.700018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba27d2a-747e-4987-94a1-785d478e6ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:26.700293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba27d2a-747e-4987-94a1-785d478e6ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:26.701007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba27d2a-747e-4987-94a1-785d478e6ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:26.701312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba27d2a-747e-4987-94a1-785d478e6ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:26.702781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba27d2a-747e-4987-94a1-785d478e6ee4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:26.714417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 631/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:26.720762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebcaa-5263-4a0c-b4da-605626279435 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:26.752386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:26.818222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebcaa-5263-4a0c-b4da-605626279435 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:26.854680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cc3b5-3e86-47f9-81db-698222445c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:26.855352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cc3b5-3e86-47f9-81db-698222445c7d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:26.855663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cc3b5-3e86-47f9-81db-698222445c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:26.855965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cc3b5-3e86-47f9-81db-698222445c7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:26.863747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cc3b5-3e86-47f9-81db-698222445c7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:26.865269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cc3b5-3e86-47f9-81db-698222445c7d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-550cc3b5-3e86-47f9-81db-698222445c7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:51:26.876741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:26.883138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:26.884271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:51:26.884271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:51:26.884271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:51:26.884271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:51:26.884271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:51:26.884271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:51:26.884271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:26.884271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:26.884271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 640/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:26.885170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba27d2a-747e-4987-94a1-785d478e6ee4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:26.943551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:26.985569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba27d2a-747e-4987-94a1-785d478e6ee4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:27.019480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dad51-02bd-4576-a107-58717dfc63cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:27.020096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dad51-02bd-4576-a107-58717dfc63cc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:27.020378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dad51-02bd-4576-a107-58717dfc63cc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:27.020654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dad51-02bd-4576-a107-58717dfc63cc None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:27.021427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dad51-02bd-4576-a107-58717dfc63cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:27.021735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dad51-02bd-4576-a107-58717dfc63cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:27.023228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dad51-02bd-4576-a107-58717dfc63cc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:27.035684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 632/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:27.041790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cc3b5-3e86-47f9-81db-698222445c7d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:27.132427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:27.141658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cc3b5-3e86-47f9-81db-698222445c7d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:27.177401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f368d8e-da9f-428f-9b8e-ee68c8ed8369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:27.178068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368d8e-da9f-428f-9b8e-ee68c8ed8369 None admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:27.178351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368d8e-da9f-428f-9b8e-ee68c8ed8369 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:27.178629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368d8e-da9f-428f-9b8e-ee68c8ed8369 None admin] PATH_INFO: `/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/4dded05b23a0469785e3a7bedf1cf851/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:27.180633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f368d8e-da9f-428f-9b8e-ee68c8ed8369 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54ffabf97d94349a57743c716eaed0b, user_id=4dded05b23a0469785e3a7bedf1cf851, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:27.182142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f368d8e-da9f-428f-9b8e-ee68c8ed8369 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:27.269853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 641/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 28 17:51:27 2022] PUT /identity/v3/projects/b54ffabf97d94349a57743c716eaed0b/users/4dded05b23a0469785e3a7bedf1cf851/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 17:51:29.289320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd8fef-5f90-4a00-a536-be1d5059be90 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.289844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd8fef-5f90-4a00-a536-be1d5059be90 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.289844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd8fef-5f90-4a00-a536-be1d5059be90 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.291213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 633/1274] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:29.296995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132322e1-44e6-4165-95bc-8b02b0056457 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.297434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132322e1-44e6-4165-95bc-8b02b0056457 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.297577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132322e1-44e6-4165-95bc-8b02b0056457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.316446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-132322e1-44e6-4165-95bc-8b02b0056457 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:29.317698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-132322e1-44e6-4165-95bc-8b02b0056457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:29.383491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 642/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:29.406215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd8fef-5f90-4a00-a536-be1d5059be90 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:29.508828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd8fef-5f90-4a00-a536-be1d5059be90 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:29.525223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:29.541927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0113e8a-d12e-4744-9100-52585da90782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:29.542562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0113e8a-d12e-4744-9100-52585da90782 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.542858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0113e8a-d12e-4744-9100-52585da90782 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.543128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0113e8a-d12e-4744-9100-52585da90782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.553494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0113e8a-d12e-4744-9100-52585da90782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e0113e8a-d12e-4744-9100-52585da90782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 17:51:29.558321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:29.559337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:29.560197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 634/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 28 17:51:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:29.565837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132322e1-44e6-4165-95bc-8b02b0056457 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:29.644916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:29.662230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132322e1-44e6-4165-95bc-8b02b0056457 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:29.695207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8649c36-f9c1-490b-b3d7-fb25615a727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:29.695811 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649c36-f9c1-490b-b3d7-fb25615a727c None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.696086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649c36-f9c1-490b-b3d7-fb25615a727c None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.696353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8649c36-f9c1-490b-b3d7-fb25615a727c None admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.697082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8649c36-f9c1-490b-b3d7-fb25615a727c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:29.697378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8649c36-f9c1-490b-b3d7-fb25615a727c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:29.698776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8649c36-f9c1-490b-b3d7-fb25615a727c None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:29.706414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 643/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 28 17:51:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:29.712924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0113e8a-d12e-4744-9100-52585da90782 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:29.812053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0113e8a-d12e-4744-9100-52585da90782 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:29.845345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e9c3e-1c43-4a44-a33f-e743dbb2b093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:29.846036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e9c3e-1c43-4a44-a33f-e743dbb2b093 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:29.846314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e9c3e-1c43-4a44-a33f-e743dbb2b093 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:29.846584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e9c3e-1c43-4a44-a33f-e743dbb2b093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:29.856475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e9c3e-1c43-4a44-a33f-e743dbb2b093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:29.858510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e9c3e-1c43-4a44-a33f-e743dbb2b093 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f76e9c3e-1c43-4a44-a33f-e743dbb2b093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:29.872899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:29.873927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:29.875137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:29.875137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:29.875137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:29.875137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:29.875137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 635/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:29.880300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8649c36-f9c1-490b-b3d7-fb25615a727c None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:29.981399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8649c36-f9c1-490b-b3d7-fb25615a727c None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:30.013500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cf284-ca04-4467-ba02-f9272dea08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:30.014657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cf284-ca04-4467-ba02-f9272dea08ee None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:30.014936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cf284-ca04-4467-ba02-f9272dea08ee None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:30.015208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cf284-ca04-4467-ba02-f9272dea08ee None admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:30.015953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cf284-ca04-4467-ba02-f9272dea08ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:30.016258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cf284-ca04-4467-ba02-f9272dea08ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:30.017652 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cf284-ca04-4467-ba02-f9272dea08ee None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:30.029068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 644/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:30.035299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e9c3e-1c43-4a44-a33f-e743dbb2b093 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:30.066689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:30.134822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e9c3e-1c43-4a44-a33f-e743dbb2b093 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:30.168168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa3f5e-f820-4ed5-9b62-71e1baf8d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:30.168839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa3f5e-f820-4ed5-9b62-71e1baf8d0ee None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:30.169121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa3f5e-f820-4ed5-9b62-71e1baf8d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:30.169391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa3f5e-f820-4ed5-9b62-71e1baf8d0ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:30.177715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa3f5e-f820-4ed5-9b62-71e1baf8d0ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:30.179135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa3f5e-f820-4ed5-9b62-71e1baf8d0ee None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d8fa3f5e-f820-4ed5-9b62-71e1baf8d0ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 17:51:30.191133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:30.193295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:30.194436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 636/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:30.198295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cf284-ca04-4467-ba02-f9272dea08ee None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:30.202354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:30.297307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cf284-ca04-4467-ba02-f9272dea08ee None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:30.332388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466e68-5461-4b7d-8802-d67af1f01958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:30.333209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466e68-5461-4b7d-8802-d67af1f01958 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:30.333622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466e68-5461-4b7d-8802-d67af1f01958 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:30.333894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466e68-5461-4b7d-8802-d67af1f01958 None admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:30.334678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20466e68-5461-4b7d-8802-d67af1f01958 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:30.334982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20466e68-5461-4b7d-8802-d67af1f01958 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:30.336420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20466e68-5461-4b7d-8802-d67af1f01958 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:30.354688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 645/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 28 17:51:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:30.361188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa3f5e-f820-4ed5-9b62-71e1baf8d0ee None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:30.450402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:30.459444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa3f5e-f820-4ed5-9b62-71e1baf8d0ee None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:30.493350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30fd35-8ade-42fc-b1c5-2956aca48e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:30.493967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30fd35-8ade-42fc-b1c5-2956aca48e5d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:30.494262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30fd35-8ade-42fc-b1c5-2956aca48e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:30.494514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30fd35-8ade-42fc-b1c5-2956aca48e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:30.561221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30fd35-8ade-42fc-b1c5-2956aca48e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:30.562659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30fd35-8ade-42fc-b1c5-2956aca48e5d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:30.649653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:30.659966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 637/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 28 17:51:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 17:51:30.665719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466e68-5461-4b7d-8802-d67af1f01958 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:30.727432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:30.767489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466e68-5461-4b7d-8802-d67af1f01958 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:30.800282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6171c-f6e1-4d75-8000-c519fa7cec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:30.800940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6171c-f6e1-4d75-8000-c519fa7cec37 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:30.801220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6171c-f6e1-4d75-8000-c519fa7cec37 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:30.801490 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6171c-f6e1-4d75-8000-c519fa7cec37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:30.811593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6171c-f6e1-4d75-8000-c519fa7cec37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:30.813056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6171c-f6e1-4d75-8000-c519fa7cec37 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-cdf6171c-f6e1-4d75-8000-c519fa7cec37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 17:51:30.827841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:30.828931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:30.830270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 17:51:30.830270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 17:51:30.830270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 17:51:30.830270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:30.830270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 646/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 17:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:30.834707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30fd35-8ade-42fc-b1c5-2956aca48e5d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:30.931841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30fd35-8ade-42fc-b1c5-2956aca48e5d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:30.964966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dde58-f06a-4d0f-880e-52d0d8e1238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:30.965588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dde58-f06a-4d0f-880e-52d0d8e1238a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:30.965886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dde58-f06a-4d0f-880e-52d0d8e1238a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:30.966136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dde58-f06a-4d0f-880e-52d0d8e1238a None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:30.966873 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dde58-f06a-4d0f-880e-52d0d8e1238a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:30.967173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dde58-f06a-4d0f-880e-52d0d8e1238a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:30.968697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dde58-f06a-4d0f-880e-52d0d8e1238a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:30.979648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 638/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 28 17:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:30.986230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6171c-f6e1-4d75-8000-c519fa7cec37 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:31.105509 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6171c-f6e1-4d75-8000-c519fa7cec37 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:31.122750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:31.145814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079641-7f98-4243-b953-5bc2fab27a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:31.146479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079641-7f98-4243-b953-5bc2fab27a3d None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:31.146764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079641-7f98-4243-b953-5bc2fab27a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:31.147040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079641-7f98-4243-b953-5bc2fab27a3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:31.153604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33079641-7f98-4243-b953-5bc2fab27a3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:31.155555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33079641-7f98-4243-b953-5bc2fab27a3d None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application [None req-33079641-7f98-4243-b953-5bc2fab27a3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 17:51:31.166787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:31.184581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:31.186272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 17:51:31.186272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 17:51:31.186272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 17:51:31.186272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 17:51:31.186272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 17:51:31.186272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 17:51:31.186272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 17:51:31.186272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: ERROR keystone.server.flask.application Jul 28 17:51:31.186272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 647/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 28 17:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:31.186891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dde58-f06a-4d0f-880e-52d0d8e1238a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:31.225339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:31.274075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dde58-f06a-4d0f-880e-52d0d8e1238a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:31.307344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76f3a7-0065-4213-891c-5db7e67a8f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:31.307963 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f3a7-0065-4213-891c-5db7e67a8f25 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:31.308242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f3a7-0065-4213-891c-5db7e67a8f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:31.308516 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f3a7-0065-4213-891c-5db7e67a8f25 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:31.309295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f3a7-0065-4213-891c-5db7e67a8f25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:31.309602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f3a7-0065-4213-891c-5db7e67a8f25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:31.311027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f3a7-0065-4213-891c-5db7e67a8f25 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:31.323628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 639/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 28 17:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:31.329965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079641-7f98-4243-b953-5bc2fab27a3d None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:31.437612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079641-7f98-4243-b953-5bc2fab27a3d None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:31.473361 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bba40-615b-4f0b-bb47-2a6ea7843d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:31.473973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bba40-615b-4f0b-bb47-2a6ea7843d61 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:31.474252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bba40-615b-4f0b-bb47-2a6ea7843d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:31.474523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bba40-615b-4f0b-bb47-2a6ea7843d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:31.475330 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bba40-615b-4f0b-bb47-2a6ea7843d61 None admin] RBAC: Adding query filter params (role.id=2c1f5ec1d39b411ab14cef7d19d674b5, scope.project.id=b54ffabf97d94349a57743c716eaed0b, user.id=4dded05b23a0469785e3a7bedf1cf851) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:31.475637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bba40-615b-4f0b-bb47-2a6ea7843d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:31.477076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bba40-615b-4f0b-bb47-2a6ea7843d61 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:31.482708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 648/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 28 17:51:31 2022] GET /identity/v3/role_assignments?user.id=4dded05b23a0469785e3a7bedf1cf851&scope.project.id=b54ffabf97d94349a57743c716eaed0b&role.id=2c1f5ec1d39b411ab14cef7d19d674b5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:33.476573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec587da-4a2c-42ae-b16b-48655006fe12 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:33.477178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec587da-4a2c-42ae-b16b-48655006fe12 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:33.477178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec587da-4a2c-42ae-b16b-48655006fe12 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:33.478428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 640/1288] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:33.483534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbdfe-1b85-4e51-a840-4735d94c4126 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:33.483926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbdfe-1b85-4e51-a840-4735d94c4126 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:33.484070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbdfe-1b85-4e51-a840-4735d94c4126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:33.502413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-544cbdfe-1b85-4e51-a840-4735d94c4126 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:33.503603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-544cbdfe-1b85-4e51-a840-4735d94c4126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:33.533012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:33.569002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 649/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:33.591312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec587da-4a2c-42ae-b16b-48655006fe12 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:33.695904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec587da-4a2c-42ae-b16b-48655006fe12 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:33.706405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:33.729153 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58aa99-955d-47c6-bad5-adf9a27f7007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:33.729441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58aa99-955d-47c6-bad5-adf9a27f7007 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:33.729716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58aa99-955d-47c6-bad5-adf9a27f7007 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:33.729982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58aa99-955d-47c6-bad5-adf9a27f7007 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:33.730594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58aa99-955d-47c6-bad5-adf9a27f7007 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:33.731939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58aa99-955d-47c6-bad5-adf9a27f7007 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1f58aa99-955d-47c6-bad5-adf9a27f7007 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:33.741315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:33.742672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:33.744152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 641/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:51:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:33.749252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cbdfe-1b85-4e51-a840-4735d94c4126 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:33.851688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cbdfe-1b85-4e51-a840-4735d94c4126 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:33.886544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad193e-2f75-4fb1-82ab-5f6a7f7baa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:33.887166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad193e-2f75-4fb1-82ab-5f6a7f7baa81 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:33.887446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad193e-2f75-4fb1-82ab-5f6a7f7baa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:33.887719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad193e-2f75-4fb1-82ab-5f6a7f7baa81 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:33.888391 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad193e-2f75-4fb1-82ab-5f6a7f7baa81 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:33.888696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad193e-2f75-4fb1-82ab-5f6a7f7baa81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:33.890123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad193e-2f75-4fb1-82ab-5f6a7f7baa81 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:33.897675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 650/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 28 17:51:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:33.904160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58aa99-955d-47c6-bad5-adf9a27f7007 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:34.003055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58aa99-955d-47c6-bad5-adf9a27f7007 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:34.035980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8a9ce-d659-45b3-a1c7-1f070d85ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:34.036591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8a9ce-d659-45b3-a1c7-1f070d85ee55 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:34.036900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8a9ce-d659-45b3-a1c7-1f070d85ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:34.037179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8a9ce-d659-45b3-a1c7-1f070d85ee55 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:34.037850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8a9ce-d659-45b3-a1c7-1f070d85ee55 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:34.038153 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8a9ce-d659-45b3-a1c7-1f070d85ee55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:34.039511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8a9ce-d659-45b3-a1c7-1f070d85ee55 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:34.043839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 642/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 28 17:51:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:36.122964 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164101ed-a5da-4a15-ad10-10a5aeeeea72 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:36.123655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164101ed-a5da-4a15-ad10-10a5aeeeea72 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:36.123655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164101ed-a5da-4a15-ad10-10a5aeeeea72 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:36.124906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 651/1293] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:36.130152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b799dd-a38b-42bf-af79-93531aab561b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:36.130583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b799dd-a38b-42bf-af79-93531aab561b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:36.131006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b799dd-a38b-42bf-af79-93531aab561b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:36.149297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-57b799dd-a38b-42bf-af79-93531aab561b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:36.150473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-57b799dd-a38b-42bf-af79-93531aab561b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:36.182522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:36.219399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 643/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:36.242030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164101ed-a5da-4a15-ad10-10a5aeeeea72 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:36.280963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:36.359482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164101ed-a5da-4a15-ad10-10a5aeeeea72 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:36.392531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c7e73-583a-4bad-8df3-3b9c15ec0db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:36.393104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7e73-583a-4bad-8df3-3b9c15ec0db9 None admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:36.393382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7e73-583a-4bad-8df3-3b9c15ec0db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:36.393656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7e73-583a-4bad-8df3-3b9c15ec0db9 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:36.394331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c7e73-583a-4bad-8df3-3b9c15ec0db9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:36.395682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c7e73-583a-4bad-8df3-3b9c15ec0db9 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:36.521373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 652/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 28 17:51:36 2022] POST /identity/v3/services => generated 246 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:51:38.553283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00660273-d7b0-47c4-939c-d1fb6df314d4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:38.553842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00660273-d7b0-47c4-939c-d1fb6df314d4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:38.553842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00660273-d7b0-47c4-939c-d1fb6df314d4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:38.555107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 644/1296] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:38.560232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3ae4-1400-4859-9f79-b11e315dbbd0 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:38.564992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3ae4-1400-4859-9f79-b11e315dbbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:38.564992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3ae4-1400-4859-9f79-b11e315dbbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:38.579017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-89fe3ae4-1400-4859-9f79-b11e315dbbd0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:38.580182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-89fe3ae4-1400-4859-9f79-b11e315dbbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:38.649773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 653/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:38.672678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00660273-d7b0-47c4-939c-d1fb6df314d4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:38.771998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00660273-d7b0-47c4-939c-d1fb6df314d4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:38.811321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a0bbd-be6f-4581-8ac5-6a54693b9d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:38.811321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0bbd-be6f-4581-8ac5-6a54693b9d11 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:38.811321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0bbd-be6f-4581-8ac5-6a54693b9d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:38.811321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0bbd-be6f-4581-8ac5-6a54693b9d11 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:38.811755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a0bbd-be6f-4581-8ac5-6a54693b9d11 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:38.811755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a0bbd-be6f-4581-8ac5-6a54693b9d11 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7e1a0bbd-be6f-4581-8ac5-6a54693b9d11 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:38.817300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:38.818445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:38.819424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 645/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:51:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:38.824727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe3ae4-1400-4859-9f79-b11e315dbbd0 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:38.843416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:38.921453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe3ae4-1400-4859-9f79-b11e315dbbd0 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:38.955943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29301617-6c5a-4a48-b377-49d56e09f3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:38.956551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301617-6c5a-4a48-b377-49d56e09f3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:38.956854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301617-6c5a-4a48-b377-49d56e09f3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:38.957129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301617-6c5a-4a48-b377-49d56e09f3a8 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:38.957837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29301617-6c5a-4a48-b377-49d56e09f3a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:38.958141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29301617-6c5a-4a48-b377-49d56e09f3a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:38.959598 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29301617-6c5a-4a48-b377-49d56e09f3a8 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:38.964635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 654/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 28 17:51:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:38.970962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a0bbd-be6f-4581-8ac5-6a54693b9d11 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:39.002484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:39.068369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a0bbd-be6f-4581-8ac5-6a54693b9d11 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:39.101735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156930-9ae9-40e6-84f9-ba160d4a8144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:39.128316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156930-9ae9-40e6-84f9-ba160d4a8144 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:39.128316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156930-9ae9-40e6-84f9-ba160d4a8144 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:39.128316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156930-9ae9-40e6-84f9-ba160d4a8144 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:39.128316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156930-9ae9-40e6-84f9-ba160d4a8144 None admin] RBAC: Adding query filter params (interface=public, service_id=c6a2d4de014944709484e306c5f58ce5, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:39.128316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156930-9ae9-40e6-84f9-ba160d4a8144 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:39.128316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156930-9ae9-40e6-84f9-ba160d4a8144 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:39.128883 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 646/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 28 17:51:38 2022] GET /identity/v3/endpoints?service_id=c6a2d4de014944709484e306c5f58ce5&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:39.128976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29301617-6c5a-4a48-b377-49d56e09f3a8 None admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:39.215187 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29301617-6c5a-4a48-b377-49d56e09f3a8 None admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:39.247569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18910e3-4bd8-4464-856c-c259a9dec94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:39.248193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18910e3-4bd8-4464-856c-c259a9dec94a None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:39.249021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18910e3-4bd8-4464-856c-c259a9dec94a None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:39.249290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18910e3-4bd8-4464-856c-c259a9dec94a None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:39.249924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18910e3-4bd8-4464-856c-c259a9dec94a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:39.251269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18910e3-4bd8-4464-856c-c259a9dec94a None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:39.257850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 655/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 28 17:51:39 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 17:51:39.269721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:41.278052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957807-2f0d-4ba7-88fc-a88d3166f0e2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:41.278557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957807-2f0d-4ba7-88fc-a88d3166f0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:41.278666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957807-2f0d-4ba7-88fc-a88d3166f0e2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:41.281589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 647/1302] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:51:41.287075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be4d3c-4568-4109-9cf7-657146833b44 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:41.287477 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be4d3c-4568-4109-9cf7-657146833b44 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:41.287651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be4d3c-4568-4109-9cf7-657146833b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:41.305313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-83be4d3c-4568-4109-9cf7-657146833b44 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:51:41.306603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-83be4d3c-4568-4109-9cf7-657146833b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:51:41.372044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 656/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:51:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 17:51:41.395178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957807-2f0d-4ba7-88fc-a88d3166f0e2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:41.489143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:41.495725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957807-2f0d-4ba7-88fc-a88d3166f0e2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:41.528772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149dd1e-3bd3-42b0-86fa-f0e8a3c004cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:41.532405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149dd1e-3bd3-42b0-86fa-f0e8a3c004cd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:41.532405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149dd1e-3bd3-42b0-86fa-f0e8a3c004cd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:41.532405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149dd1e-3bd3-42b0-86fa-f0e8a3c004cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:41.532405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149dd1e-3bd3-42b0-86fa-f0e8a3c004cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:41.532405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149dd1e-3bd3-42b0-86fa-f0e8a3c004cd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0149dd1e-3bd3-42b0-86fa-f0e8a3c004cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 17:51:41.540536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 17:51:41.541769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Jul 28 17:51:41.542666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 648/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 28 17:51:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 17:51:41.548130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be4d3c-4568-4109-9cf7-657146833b44 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:41.622098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:41.644552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be4d3c-4568-4109-9cf7-657146833b44 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:41.676491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ca6fa-82e8-48f2-9955-4395d42e1fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:41.677105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ca6fa-82e8-48f2-9955-4395d42e1fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:41.677382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ca6fa-82e8-48f2-9955-4395d42e1fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:41.677651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ca6fa-82e8-48f2-9955-4395d42e1fb2 None admin] PATH_INFO: `/v3/services` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:41.678310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ca6fa-82e8-48f2-9955-4395d42e1fb2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 17:51:41.678606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ca6fa-82e8-48f2-9955-4395d42e1fb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:41.679962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ca6fa-82e8-48f2-9955-4395d42e1fb2 None admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:41.684854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 657/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 28 17:51:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 17:51:41.691405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149dd1e-3bd3-42b0-86fa-f0e8a3c004cd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:51:41.789712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149dd1e-3bd3-42b0-86fa-f0e8a3c004cd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:51:41.822206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6007f1-336e-4eb4-bcdc-da40887e4609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:51:41.822811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6007f1-336e-4eb4-bcdc-da40887e4609 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:51:41.823092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6007f1-336e-4eb4-bcdc-da40887e4609 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:51:41.823367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6007f1-336e-4eb4-bcdc-da40887e4609 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:51:41.824126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6007f1-336e-4eb4-bcdc-da40887e4609 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:51:41.825510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6007f1-336e-4eb4-bcdc-da40887e4609 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:51:41.984503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 649/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 17:51:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 17:51:51.921490 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=30 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:51:51.978901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:42.933711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a29cd2-9f46-451a-866c-73587bcffad4 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:42.933711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a29cd2-9f46-451a-866c-73587bcffad4 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:42.933711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a29cd2-9f46-451a-866c-73587bcffad4 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:42.940041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f496ad4-c395-4e92-ab34-030f9f4b787e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:42.940449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f496ad4-c395-4e92-ab34-030f9f4b787e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:42.940631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f496ad4-c395-4e92-ab34-030f9f4b787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:42.943495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 658/1307] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:59:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:43.066553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3f496ad4-c395-4e92-ab34-030f9f4b787e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:43.068016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3f496ad4-c395-4e92-ab34-030f9f4b787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:43.192821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 650/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 17:59:43.243218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d43eb-df5e-469e-acfd-096ed52cfb5a None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:43.243504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d43eb-df5e-469e-acfd-096ed52cfb5a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:43.244043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d43eb-df5e-469e-acfd-096ed52cfb5a None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:43.245605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 659/1309] 10.222.0.67 () {54 vars in 965 bytes} [Thu Jul 28 17:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:43.251701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166376-4c56-47b1-a360-795544293b25 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:43.251998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166376-4c56-47b1-a360-795544293b25 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:43.252275 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166376-4c56-47b1-a360-795544293b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:43.347487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a4166376-4c56-47b1-a360-795544293b25 None None] MFA Rules not processed for user `0116171a83f5444d91ce0ea2439a9bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:43.349634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a4166376-4c56-47b1-a360-795544293b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:43.372140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:43.429014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 651/1310] 10.222.0.67 () {58 vars in 1062 bytes} [Thu Jul 28 17:59:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:43.438384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d43eb-df5e-469e-acfd-096ed52cfb5a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:43.440140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7f6d43eb-df5e-469e-acfd-096ed52cfb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:43.571867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d43eb-df5e-469e-acfd-096ed52cfb5a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:43.649165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2d12a-201a-4b5a-8da8-b2e355485e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:43.692743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d12a-201a-4b5a-8da8-b2e355485e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:43.692743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d12a-201a-4b5a-8da8-b2e355485e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:43.692743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d12a-201a-4b5a-8da8-b2e355485e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:43.692743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-95a2d12a-201a-4b5a-8da8-b2e355485e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:43.710195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:43.767280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d12a-201a-4b5a-8da8-b2e355485e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:43.769003 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d12a-201a-4b5a-8da8-b2e355485e3b service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:43.790846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 660/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 17:59:46.085306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f002d8-512e-4c88-994c-23f80643abd0 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:46.085886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f002d8-512e-4c88-994c-23f80643abd0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:46.085886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f002d8-512e-4c88-994c-23f80643abd0 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:46.087195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 652/1312] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:46.092362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb0454-3c00-49a6-a88e-882458d63929 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:46.092763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb0454-3c00-49a6-a88e-882458d63929 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:46.092987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb0454-3c00-49a6-a88e-882458d63929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:46.171320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b5bb0454-3c00-49a6-a88e-882458d63929 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:46.172722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b5bb0454-3c00-49a6-a88e-882458d63929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:46.275906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 661/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:46.315064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f002d8-512e-4c88-994c-23f80643abd0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:46.316665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-15f002d8-512e-4c88-994c-23f80643abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:46.418531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f002d8-512e-4c88-994c-23f80643abd0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:46.490100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:46.492814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92592a14-f07f-40e8-9503-30da5b1029de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:46.493444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92592a14-f07f-40e8-9503-30da5b1029de service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:46.493721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92592a14-f07f-40e8-9503-30da5b1029de service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:46.493985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92592a14-f07f-40e8-9503-30da5b1029de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:46.495641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-92592a14-f07f-40e8-9503-30da5b1029de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:46.606728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92592a14-f07f-40e8-9503-30da5b1029de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:46.608164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92592a14-f07f-40e8-9503-30da5b1029de service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:46.625776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 653/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:49.238322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc645cb-e911-45f7-a717-da351dfc437d None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:49.238871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc645cb-e911-45f7-a717-da351dfc437d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:49.238871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc645cb-e911-45f7-a717-da351dfc437d None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:49.240251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 662/1315] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:49.245531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd7454-bf27-499d-9815-6060bdfe6114 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:49.245988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd7454-bf27-499d-9815-6060bdfe6114 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:49.246118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd7454-bf27-499d-9815-6060bdfe6114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:49.312429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e9dd7454-bf27-499d-9815-6060bdfe6114 None None] MFA Rules not processed for user `7ff0fdbd5cea443b8457e0eba48b93ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:49.313769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e9dd7454-bf27-499d-9815-6060bdfe6114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:49.367435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:49.413754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 654/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:49.453547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc645cb-e911-45f7-a717-da351dfc437d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:49.455059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8dc645cb-e911-45f7-a717-da351dfc437d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:49.464721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:49.560719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc645cb-e911-45f7-a717-da351dfc437d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:49.633621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b453c-5c22-45e5-899e-ca60b7387f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:49.634234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b453c-5c22-45e5-899e-ca60b7387f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:49.634513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b453c-5c22-45e5-899e-ca60b7387f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:49.634785 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b453c-5c22-45e5-899e-ca60b7387f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:49.636463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-de4b453c-5c22-45e5-899e-ca60b7387f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:49.698767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:49.747864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b453c-5c22-45e5-899e-ca60b7387f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:49.749314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b453c-5c22-45e5-899e-ca60b7387f29 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:49.766662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 663/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:52.610261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e1f42-2c19-4f84-98cf-d6e9a9f1900a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:52.610774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e1f42-2c19-4f84-98cf-d6e9a9f1900a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:52.610867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e1f42-2c19-4f84-98cf-d6e9a9f1900a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:52.612169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 655/1318] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:52.617839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad915-ae8c-4784-9391-3497eef509a1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:52.618217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad915-ae8c-4784-9391-3497eef509a1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:52.618385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad915-ae8c-4784-9391-3497eef509a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:52.682543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-45aad915-ae8c-4784-9391-3497eef509a1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:52.683737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-45aad915-ae8c-4784-9391-3497eef509a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:52.777773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 664/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:52.816696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e1f42-2c19-4f84-98cf-d6e9a9f1900a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:52.818272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-406e1f42-2c19-4f84-98cf-d6e9a9f1900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:52.919827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e1f42-2c19-4f84-98cf-d6e9a9f1900a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:52.991459 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5edd8f-7a6f-4b47-bd86-fa376ad0c996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:52.992072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5edd8f-7a6f-4b47-bd86-fa376ad0c996 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:52.992355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5edd8f-7a6f-4b47-bd86-fa376ad0c996 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:52.992625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5edd8f-7a6f-4b47-bd86-fa376ad0c996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:52.994283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2c5edd8f-7a6f-4b47-bd86-fa376ad0c996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:53.002423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:53.102302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5edd8f-7a6f-4b47-bd86-fa376ad0c996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:53.103680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5edd8f-7a6f-4b47-bd86-fa376ad0c996 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:53.121821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 656/1320] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:56.169634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db69d-7577-4357-a52b-55bb53495a32 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:56.170154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db69d-7577-4357-a52b-55bb53495a32 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:56.170236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db69d-7577-4357-a52b-55bb53495a32 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:56.171540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 665/1321] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:56.176855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08c707-4541-4443-b12c-e737d245b36f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:56.177289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08c707-4541-4443-b12c-e737d245b36f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:56.177410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08c707-4541-4443-b12c-e737d245b36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:56.242869 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cb08c707-4541-4443-b12c-e737d245b36f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:56.244067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cb08c707-4541-4443-b12c-e737d245b36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:56.303514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:56.346612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 657/1322] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:56.382079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196db69d-7577-4357-a52b-55bb53495a32 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:56.383685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-196db69d-7577-4357-a52b-55bb53495a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:56.403900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:56.489298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196db69d-7577-4357-a52b-55bb53495a32 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:56.570439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45d98-ad44-431e-b6fa-6ba4c0b59224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:56.571068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45d98-ad44-431e-b6fa-6ba4c0b59224 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:56.571347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45d98-ad44-431e-b6fa-6ba4c0b59224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:56.571619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45d98-ad44-431e-b6fa-6ba4c0b59224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:56.573314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d3b45d98-ad44-431e-b6fa-6ba4c0b59224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:56.652705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:56.693158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45d98-ad44-431e-b6fa-6ba4c0b59224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:56.695280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45d98-ad44-431e-b6fa-6ba4c0b59224 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:56.715205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 666/1323] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 17:59:58.800491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46bfc1-5e23-4d71-9a52-ab40c209b3f6 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:58.801043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46bfc1-5e23-4d71-9a52-ab40c209b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:58.801043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46bfc1-5e23-4d71-9a52-ab40c209b3f6 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:58.802370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 658/1324] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 17:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 17:59:58.808240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe141a0-a356-4947-a2b0-a5d42711c996 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:58.808702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe141a0-a356-4947-a2b0-a5d42711c996 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:58.808834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe141a0-a356-4947-a2b0-a5d42711c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:58.875913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8fe141a0-a356-4947-a2b0-a5d42711c996 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 17:59:58.877151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8fe141a0-a356-4947-a2b0-a5d42711c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:58.977357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 667/1325] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 17:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 17:59:59.014042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46bfc1-5e23-4d71-9a52-ab40c209b3f6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 17:59:59.015632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9d46bfc1-5e23-4d71-9a52-ab40c209b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:59.129380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46bfc1-5e23-4d71-9a52-ab40c209b3f6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 17:59:59.218778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cbfe5-bc7b-4b1f-9426-6f8d5c9c4bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 17:59:59.219502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cbfe5-bc7b-4b1f-9426-6f8d5c9c4bee service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 17:59:59.219780 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cbfe5-bc7b-4b1f-9426-6f8d5c9c4bee service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 17:59:59.220046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cbfe5-bc7b-4b1f-9426-6f8d5c9c4bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 17:59:59.221697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f45cbfe5-bc7b-4b1f-9426-6f8d5c9c4bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 17:59:59.239540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:59.330083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cbfe5-bc7b-4b1f-9426-6f8d5c9c4bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 17:59:59.331521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cbfe5-bc7b-4b1f-9426-6f8d5c9c4bee service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 17:59:59.350858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 659/1326] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 17:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:01.413193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868c88-df6a-4b92-acd2-188e373ce12c None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:01.413764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868c88-df6a-4b92-acd2-188e373ce12c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:01.413764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50868c88-df6a-4b92-acd2-188e373ce12c None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:01.415098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 668/1327] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:01.420313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ef97f-25f9-4395-99b7-b7fc2f7bce82 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:01.420745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ef97f-25f9-4395-99b7-b7fc2f7bce82 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:01.420962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ef97f-25f9-4395-99b7-b7fc2f7bce82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:01.487974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-183ef97f-25f9-4395-99b7-b7fc2f7bce82 None None] MFA Rules not processed for user `7ff0fdbd5cea443b8457e0eba48b93ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:01.489214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-183ef97f-25f9-4395-99b7-b7fc2f7bce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:01.557744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:01.590009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 660/1328] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:01.628243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50868c88-df6a-4b92-acd2-188e373ce12c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:01.629900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-50868c88-df6a-4b92-acd2-188e373ce12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:01.660880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:01.736841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50868c88-df6a-4b92-acd2-188e373ce12c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:01.811371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4fcb0-d30d-43b7-b91e-a697d908face service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:01.811994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4fcb0-d30d-43b7-b91e-a697d908face service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:01.812279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4fcb0-d30d-43b7-b91e-a697d908face service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:01.812553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4fcb0-d30d-43b7-b91e-a697d908face service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:01.814261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-27f4fcb0-d30d-43b7-b91e-a697d908face service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:01.895889 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:01.928154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4fcb0-d30d-43b7-b91e-a697d908face service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:01.930086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4fcb0-d30d-43b7-b91e-a697d908face service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:01.950352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 669/1329] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:04.503146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e0abc-c9fd-4f7f-94b1-3899f393f475 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:04.503712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e0abc-c9fd-4f7f-94b1-3899f393f475 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:04.503712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e0abc-c9fd-4f7f-94b1-3899f393f475 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:04.505230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 661/1330] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:04.510952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6025-7ae0-462a-a8e0-e40c8f6c2bca None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:04.511367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6025-7ae0-462a-a8e0-e40c8f6c2bca None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:04.511530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6025-7ae0-462a-a8e0-e40c8f6c2bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:04.579134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-913d6025-7ae0-462a-a8e0-e40c8f6c2bca None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:04.580572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-913d6025-7ae0-462a-a8e0-e40c8f6c2bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:04.678506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 670/1331] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:04.715185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e0abc-c9fd-4f7f-94b1-3899f393f475 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:04.717526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4a0e0abc-c9fd-4f7f-94b1-3899f393f475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:04.822481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e0abc-c9fd-4f7f-94b1-3899f393f475 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:04.895524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03fe81-ba08-4d83-84ef-edf8f47df800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:04.896140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03fe81-ba08-4d83-84ef-edf8f47df800 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:04.896418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03fe81-ba08-4d83-84ef-edf8f47df800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:04.896689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03fe81-ba08-4d83-84ef-edf8f47df800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:04.898387 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ff03fe81-ba08-4d83-84ef-edf8f47df800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:04.924033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:05.004453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03fe81-ba08-4d83-84ef-edf8f47df800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:05.005904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03fe81-ba08-4d83-84ef-edf8f47df800 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:05.024141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 662/1332] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:07.069731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b4d59-ff8d-435d-be6b-93752562f295 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:07.070302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b4d59-ff8d-435d-be6b-93752562f295 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:07.070302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b4d59-ff8d-435d-be6b-93752562f295 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:07.071622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 671/1333] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:07.076945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e04d2a-92e6-441a-ab91-a0851b0ffe74 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:07.077323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e04d2a-92e6-441a-ab91-a0851b0ffe74 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:07.077518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e04d2a-92e6-441a-ab91-a0851b0ffe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:07.141698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-64e04d2a-92e6-441a-ab91-a0851b0ffe74 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:07.142905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-64e04d2a-92e6-441a-ab91-a0851b0ffe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:07.216080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:07.237378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 663/1334] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:07.292689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a01aea-00a8-4991-b27e-34668831e688 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:07.293001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a01aea-00a8-4991-b27e-34668831e688 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:07.293277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a01aea-00a8-4991-b27e-34668831e688 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:07.294620 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 672/1335] 10.222.0.67 () {54 vars in 965 bytes} [Thu Jul 28 18:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:07.301204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b239683-fb23-4665-9bc1-ad6f146bd9f1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:07.301515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b239683-fb23-4665-9bc1-ad6f146bd9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:07.301792 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b239683-fb23-4665-9bc1-ad6f146bd9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:07.377535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8b239683-fb23-4665-9bc1-ad6f146bd9f1 None None] MFA Rules not processed for user `0116171a83f5444d91ce0ea2439a9bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:07.378669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8b239683-fb23-4665-9bc1-ad6f146bd9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:07.453418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 664/1336] 10.222.0.67 () {58 vars in 1062 bytes} [Thu Jul 28 18:00:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:00:07.462406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a01aea-00a8-4991-b27e-34668831e688 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:07.464001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b8a01aea-00a8-4991-b27e-34668831e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:07.503565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:07.566193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a01aea-00a8-4991-b27e-34668831e688 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:07.638832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12aef95-609e-44e2-8dc9-1586d14758f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:07.639370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aef95-609e-44e2-8dc9-1586d14758f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:07.639651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aef95-609e-44e2-8dc9-1586d14758f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:07.639924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aef95-609e-44e2-8dc9-1586d14758f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:07.641560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c12aef95-609e-44e2-8dc9-1586d14758f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:07.723744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:07.749513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12aef95-609e-44e2-8dc9-1586d14758f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:07.750974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12aef95-609e-44e2-8dc9-1586d14758f5 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:07.768906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 673/1337] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:10.932230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c3a5-0de5-4c79-9359-2bdf689de9b8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:10.932762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c3a5-0de5-4c79-9359-2bdf689de9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:10.932762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c3a5-0de5-4c79-9359-2bdf689de9b8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:10.934178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 665/1338] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:00:10.940475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a135ee-9022-4a8c-bc65-8f1d63cb34e1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:10.940996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a135ee-9022-4a8c-bc65-8f1d63cb34e1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:10.941087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a135ee-9022-4a8c-bc65-8f1d63cb34e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:11.018342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-40a135ee-9022-4a8c-bc65-8f1d63cb34e1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:11.019571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-40a135ee-9022-4a8c-bc65-8f1d63cb34e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:11.121649 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 674/1339] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:11.158562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c3a5-0de5-4c79-9359-2bdf689de9b8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:11.160201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7a11c3a5-0de5-4c79-9359-2bdf689de9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:11.239252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:11.267440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c3a5-0de5-4c79-9359-2bdf689de9b8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:11.340418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973ff83-e2aa-4f50-8d56-a652e5ed8b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:11.341054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ff83-e2aa-4f50-8d56-a652e5ed8b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:11.341330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ff83-e2aa-4f50-8d56-a652e5ed8b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:11.341600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ff83-e2aa-4f50-8d56-a652e5ed8b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:11.343194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c973ff83-e2aa-4f50-8d56-a652e5ed8b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:11.452297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973ff83-e2aa-4f50-8d56-a652e5ed8b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:11.453753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973ff83-e2aa-4f50-8d56-a652e5ed8b1b service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:11.472076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 666/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:15.850669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e0d9-5828-4cd2-b7ad-a432e97c37bd None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:15.851265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e0d9-5828-4cd2-b7ad-a432e97c37bd None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:15.851265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e0d9-5828-4cd2-b7ad-a432e97c37bd None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:15.852635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 675/1341] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:15.858721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d741ab-e193-4f75-b487-6aa71c8ca23c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:15.859263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d741ab-e193-4f75-b487-6aa71c8ca23c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:15.859586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d741ab-e193-4f75-b487-6aa71c8ca23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:15.866630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:15.934723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-18d741ab-e193-4f75-b487-6aa71c8ca23c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:15.936013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-18d741ab-e193-4f75-b487-6aa71c8ca23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:16.043893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 667/1342] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:00:16.085755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e0d9-5828-4cd2-b7ad-a432e97c37bd None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:16.087282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-88e9e0d9-5828-4cd2-b7ad-a432e97c37bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:16.141968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:16.201438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e0d9-5828-4cd2-b7ad-a432e97c37bd None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:16.275146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25b5a6-ffdd-49b0-a297-e085807b0563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:16.275688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25b5a6-ffdd-49b0-a297-e085807b0563 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:16.275965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25b5a6-ffdd-49b0-a297-e085807b0563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:16.276236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25b5a6-ffdd-49b0-a297-e085807b0563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:16.277881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6a25b5a6-ffdd-49b0-a297-e085807b0563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:16.369169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:16.385924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25b5a6-ffdd-49b0-a297-e085807b0563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:16.387367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25b5a6-ffdd-49b0-a297-e085807b0563 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:16.405761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 676/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:19.558761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9921f-002c-42d6-875d-fc2cb1ef35f9 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:19.559265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9921f-002c-42d6-875d-fc2cb1ef35f9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:19.559265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9921f-002c-42d6-875d-fc2cb1ef35f9 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:19.560668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 668/1344] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:19.565873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd35d8-5197-4b5f-947d-8586f9fc9554 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:19.566316 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd35d8-5197-4b5f-947d-8586f9fc9554 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:19.566421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd35d8-5197-4b5f-947d-8586f9fc9554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:19.636593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-66dd35d8-5197-4b5f-947d-8586f9fc9554 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:19.636593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-66dd35d8-5197-4b5f-947d-8586f9fc9554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:19.734050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 677/1345] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:19.772261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9921f-002c-42d6-875d-fc2cb1ef35f9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:19.773908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3cd9921f-002c-42d6-875d-fc2cb1ef35f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:19.863746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:19.881474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9921f-002c-42d6-875d-fc2cb1ef35f9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:19.959202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0fb7b-62bc-4321-a388-c93aaf30cd90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:19.959828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0fb7b-62bc-4321-a388-c93aaf30cd90 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:19.960137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0fb7b-62bc-4321-a388-c93aaf30cd90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:19.960413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0fb7b-62bc-4321-a388-c93aaf30cd90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:19.962170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6bf0fb7b-62bc-4321-a388-c93aaf30cd90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:20.075897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0fb7b-62bc-4321-a388-c93aaf30cd90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:20.077370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0fb7b-62bc-4321-a388-c93aaf30cd90 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:20.095535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 669/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:24.826531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a93a6-0028-4cdf-b58d-28186d11f7b2 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:24.827061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a93a6-0028-4cdf-b58d-28186d11f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:24.827061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a93a6-0028-4cdf-b58d-28186d11f7b2 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:24.828437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 678/1347] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:24.833966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f8a2c-99c2-465c-b31f-2f84cb529e3f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:24.834950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f8a2c-99c2-465c-b31f-2f84cb529e3f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:24.835064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f8a2c-99c2-465c-b31f-2f84cb529e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:24.851032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:24.905966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-180f8a2c-99c2-465c-b31f-2f84cb529e3f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:24.907184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-180f8a2c-99c2-465c-b31f-2f84cb529e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:25.007934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 670/1348] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:25.046831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a93a6-0028-4cdf-b58d-28186d11f7b2 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:25.048383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-585a93a6-0028-4cdf-b58d-28186d11f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:25.111923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:25.159068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a93a6-0028-4cdf-b58d-28186d11f7b2 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:25.235529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f52a8-dd83-414f-9813-ae0dfef9aeb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:25.236153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f52a8-dd83-414f-9813-ae0dfef9aeb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:25.236432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f52a8-dd83-414f-9813-ae0dfef9aeb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:25.236701 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f52a8-dd83-414f-9813-ae0dfef9aeb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:25.238351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-072f52a8-dd83-414f-9813-ae0dfef9aeb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:25.352684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:25.356339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f52a8-dd83-414f-9813-ae0dfef9aeb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:25.357850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f52a8-dd83-414f-9813-ae0dfef9aeb7 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:25.376599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 679/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:30.243159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d255b2-5dd3-4587-be4d-96f5172b2f55 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:30.244023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d255b2-5dd3-4587-be4d-96f5172b2f55 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:30.244524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d255b2-5dd3-4587-be4d-96f5172b2f55 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:30.246460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 671/1350] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:30.253026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bc359-df6e-4d9b-b966-fa370024de29 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:30.253464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bc359-df6e-4d9b-b966-fa370024de29 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:30.253561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bc359-df6e-4d9b-b966-fa370024de29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:30.366864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-be0bc359-df6e-4d9b-b966-fa370024de29 None None] MFA Rules not processed for user `4dded05b23a0469785e3a7bedf1cf851`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:30.367965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-be0bc359-df6e-4d9b-b966-fa370024de29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:30.497315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 680/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:00:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:34.529702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118fd48-9bbf-4088-a31e-f613ff4c73cb None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:34.530206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118fd48-9bbf-4088-a31e-f613ff4c73cb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:34.530569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118fd48-9bbf-4088-a31e-f613ff4c73cb None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:34.532197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 672/1352] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:34.537282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73443984-ada5-462f-ae9b-eb64efecdb23 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:34.537685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73443984-ada5-462f-ae9b-eb64efecdb23 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:34.537924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73443984-ada5-462f-ae9b-eb64efecdb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:34.594116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:34.616476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-73443984-ada5-462f-ae9b-eb64efecdb23 None None] MFA Rules not processed for user `4dded05b23a0469785e3a7bedf1cf851`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:34.617710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-73443984-ada5-462f-ae9b-eb64efecdb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:34.744850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 681/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:00:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:35.006062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=59 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:36.299063 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25a8e-c395-4afc-939d-dad242bbec2e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:36.299762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25a8e-c395-4afc-939d-dad242bbec2e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:36.299762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb25a8e-c395-4afc-939d-dad242bbec2e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:36.300982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 673/1354] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:00:36.306027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb2ddc-04f1-43bf-9742-99007e139c3c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:36.306427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb2ddc-04f1-43bf-9742-99007e139c3c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:36.306587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb2ddc-04f1-43bf-9742-99007e139c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:36.388020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2bfb2ddc-04f1-43bf-9742-99007e139c3c None None] MFA Rules not processed for user `4dded05b23a0469785e3a7bedf1cf851`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:36.389254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2bfb2ddc-04f1-43bf-9742-99007e139c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:36.431441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:36.497462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 682/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:00:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:00:39.835577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542c47-2e49-4eb9-a468-dbe55ab1614e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:39.837315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542c47-2e49-4eb9-a468-dbe55ab1614e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:39.837844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542c47-2e49-4eb9-a468-dbe55ab1614e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:39.839538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 674/1356] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:39.846017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e3b9e-5950-49a6-89d3-738d174685e4 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:39.848048 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e3b9e-5950-49a6-89d3-738d174685e4 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:39.848551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e3b9e-5950-49a6-89d3-738d174685e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:39.933154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-674e3b9e-5950-49a6-89d3-738d174685e4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:39.934947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-674e3b9e-5950-49a6-89d3-738d174685e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:40.046659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 683/1357] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:40.101478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a31f0-8eaf-4036-b748-0e9767f3c639 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:40.102078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a31f0-8eaf-4036-b748-0e9767f3c639 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:40.102517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a31f0-8eaf-4036-b748-0e9767f3c639 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:40.104254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 675/1358] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 28 18:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:40.113461 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415f945-0a7a-4bb7-a86f-b8ab830f9e5e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:40.114121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415f945-0a7a-4bb7-a86f-b8ab830f9e5e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:40.114610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415f945-0a7a-4bb7-a86f-b8ab830f9e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:40.133723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:40.205234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b415f945-0a7a-4bb7-a86f-b8ab830f9e5e None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:40.206422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b415f945-0a7a-4bb7-a86f-b8ab830f9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:40.331600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 684/1359] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 28 18:00:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:40.341260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a31f0-8eaf-4036-b748-0e9767f3c639 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:40.342982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cc8a31f0-8eaf-4036-b748-0e9767f3c639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:40.521215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a31f0-8eaf-4036-b748-0e9767f3c639 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:40.613452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:40.655252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e3102-be5e-4c6b-9a45-fb075b06eed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:40.656031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3102-be5e-4c6b-9a45-fb075b06eed0 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:40.656414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3102-be5e-4c6b-9a45-fb075b06eed0 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:40.656812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3102-be5e-4c6b-9a45-fb075b06eed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:40.658534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3b8e3102-be5e-4c6b-9a45-fb075b06eed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:40.761024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e3102-be5e-4c6b-9a45-fb075b06eed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:40.762903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e3102-be5e-4c6b-9a45-fb075b06eed0 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:40.782310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 676/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:43.087089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119f5a4-43a7-4a8f-90f9-d228eaa15269 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:43.087650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119f5a4-43a7-4a8f-90f9-d228eaa15269 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:43.087735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119f5a4-43a7-4a8f-90f9-d228eaa15269 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:43.089305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 685/1361] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:43.094665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2a9b6-5811-41e1-b882-0f4debb2db9d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:43.095156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2a9b6-5811-41e1-b882-0f4debb2db9d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:43.095272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2a9b6-5811-41e1-b882-0f4debb2db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:43.169769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9ea2a9b6-5811-41e1-b882-0f4debb2db9d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:43.170976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9ea2a9b6-5811-41e1-b882-0f4debb2db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:43.214839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:43.278995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 677/1362] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:43.326945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119f5a4-43a7-4a8f-90f9-d228eaa15269 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:43.328722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1119f5a4-43a7-4a8f-90f9-d228eaa15269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:43.408506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:43.511583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119f5a4-43a7-4a8f-90f9-d228eaa15269 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:43.657201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f8ed-2ffa-4de6-ba36-c13c9268bbe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:43.657757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f8ed-2ffa-4de6-ba36-c13c9268bbe9 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:43.658153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f8ed-2ffa-4de6-ba36-c13c9268bbe9 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:43.658437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f8ed-2ffa-4de6-ba36-c13c9268bbe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:43.660078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e2a2f8ed-2ffa-4de6-ba36-c13c9268bbe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:43.689219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:43.764535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f8ed-2ffa-4de6-ba36-c13c9268bbe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:43.766286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f8ed-2ffa-4de6-ba36-c13c9268bbe9 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:43.786658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 686/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:46.637758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2563-8284-4ced-adcc-409dd814388d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:46.638363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2563-8284-4ced-adcc-409dd814388d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:46.638363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2563-8284-4ced-adcc-409dd814388d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:46.639669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 678/1364] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:46.644955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b364b-9c10-4612-975a-2ba405c6076b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:46.645359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b364b-9c10-4612-975a-2ba405c6076b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:46.645529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b364b-9c10-4612-975a-2ba405c6076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:46.719858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-841b364b-9c10-4612-975a-2ba405c6076b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:46.720998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-841b364b-9c10-4612-975a-2ba405c6076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:46.832018 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:46.841159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 687/1365] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:46.881730 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337e37b-3b1f-4feb-a4af-79c21bedd10a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:46.882178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337e37b-3b1f-4feb-a4af-79c21bedd10a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:46.882574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337e37b-3b1f-4feb-a4af-79c21bedd10a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:46.884352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 679/1366] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 28 18:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:46.890402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571b4f2-3dfe-4124-bb9e-59d92ed47132 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:46.893992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571b4f2-3dfe-4124-bb9e-59d92ed47132 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:46.893992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571b4f2-3dfe-4124-bb9e-59d92ed47132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:46.975225 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c571b4f2-3dfe-4124-bb9e-59d92ed47132 None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:46.976599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c571b4f2-3dfe-4124-bb9e-59d92ed47132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:47.100921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 688/1367] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 28 18:00:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:47.109781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337e37b-3b1f-4feb-a4af-79c21bedd10a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:47.111412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5337e37b-3b1f-4feb-a4af-79c21bedd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:47.273026 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337e37b-3b1f-4feb-a4af-79c21bedd10a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:47.294451 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:47.398526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0dfa4-8490-48a0-bc5d-6c9147df4ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:47.399056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0dfa4-8490-48a0-bc5d-6c9147df4ab3 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:47.399336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0dfa4-8490-48a0-bc5d-6c9147df4ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:47.399607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0dfa4-8490-48a0-bc5d-6c9147df4ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:47.401283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-97e0dfa4-8490-48a0-bc5d-6c9147df4ab3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:47.497250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0dfa4-8490-48a0-bc5d-6c9147df4ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:47.498893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0dfa4-8490-48a0-bc5d-6c9147df4ab3 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:47.518031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 680/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:48.329174 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f99c12-4580-492c-9239-9bd74c6f7b5c None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:48.329700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f99c12-4580-492c-9239-9bd74c6f7b5c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:48.329700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f99c12-4580-492c-9239-9bd74c6f7b5c None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:48.331269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 689/1369] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:48.336480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697caa11-7be5-416e-a41e-eac7cc54f2c6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:48.336960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697caa11-7be5-416e-a41e-eac7cc54f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:48.337063 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697caa11-7be5-416e-a41e-eac7cc54f2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:48.370239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:48.409511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-697caa11-7be5-416e-a41e-eac7cc54f2c6 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:48.411085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-697caa11-7be5-416e-a41e-eac7cc54f2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:48.515432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 681/1370] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:00:48.854169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39996-49ea-474f-839d-c2580cfa92df None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:48.854169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39996-49ea-474f-839d-c2580cfa92df None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:48.854169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39996-49ea-474f-839d-c2580cfa92df None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:48.855875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 690/1371] 10.222.0.67 () {54 vars in 964 bytes} [Thu Jul 28 18:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:48.860158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fcb97-6665-4690-b6a9-3802b370b664 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:48.860158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fcb97-6665-4690-b6a9-3802b370b664 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:48.860158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fcb97-6665-4690-b6a9-3802b370b664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:48.941680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-432fcb97-6665-4690-b6a9-3802b370b664 None None] MFA Rules not processed for user `3a4c879f65c24edea2404cb74ac37025`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:48.943407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-432fcb97-6665-4690-b6a9-3802b370b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:48.992098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:49.024529 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 682/1372] 10.222.0.67 () {58 vars in 1061 bytes} [Thu Jul 28 18:00:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:49.031850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39996-49ea-474f-839d-c2580cfa92df None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:49.033629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c7d39996-49ea-474f-839d-c2580cfa92df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:49.095923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:49.154158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39996-49ea-474f-839d-c2580cfa92df None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:49.244737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2874f-c27f-46ef-95e8-0820ee58b024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:49.245388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2874f-c27f-46ef-95e8-0820ee58b024 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:49.245668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2874f-c27f-46ef-95e8-0820ee58b024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:49.245957 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2874f-c27f-46ef-95e8-0820ee58b024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:49.247586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a2c2874f-c27f-46ef-95e8-0820ee58b024 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:49.370362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:49.384194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2874f-c27f-46ef-95e8-0820ee58b024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:49.385791 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2874f-c27f-46ef-95e8-0820ee58b024 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:49.405402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 691/1373] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:00:49.793033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092655d8-9670-431a-b30d-b04cbe642df1 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:49.793466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092655d8-9670-431a-b30d-b04cbe642df1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:49.793818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092655d8-9670-431a-b30d-b04cbe642df1 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:49.795780 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 683/1374] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:49.801117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ad6cf-2396-4d3f-aa40-d4cb304e75a4 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:49.801718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ad6cf-2396-4d3f-aa40-d4cb304e75a4 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:49.801718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ad6cf-2396-4d3f-aa40-d4cb304e75a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:49.874931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-511ad6cf-2396-4d3f-aa40-d4cb304e75a4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:49.876332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-511ad6cf-2396-4d3f-aa40-d4cb304e75a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:49.973642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 692/1375] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:50.018881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092655d8-9670-431a-b30d-b04cbe642df1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:50.020582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-092655d8-9670-431a-b30d-b04cbe642df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:50.173007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092655d8-9670-431a-b30d-b04cbe642df1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:50.226057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:50.292300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85040e7d-5d36-4c1e-8b97-4c30740cd801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:50.292988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85040e7d-5d36-4c1e-8b97-4c30740cd801 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:50.293272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85040e7d-5d36-4c1e-8b97-4c30740cd801 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:50.293546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85040e7d-5d36-4c1e-8b97-4c30740cd801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:50.295240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-85040e7d-5d36-4c1e-8b97-4c30740cd801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:50.394193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85040e7d-5d36-4c1e-8b97-4c30740cd801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:50.395845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85040e7d-5d36-4c1e-8b97-4c30740cd801 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:50.416304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 684/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:52.724708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36703c56-ad36-4bbd-82eb-0bf3ed18e69c None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:52.725242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36703c56-ad36-4bbd-82eb-0bf3ed18e69c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:52.725348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36703c56-ad36-4bbd-82eb-0bf3ed18e69c None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:52.726651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 693/1377] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:52.731851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739aff-4666-4e31-a413-8ac30d416d75 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:52.732291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739aff-4666-4e31-a413-8ac30d416d75 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:52.732539 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739aff-4666-4e31-a413-8ac30d416d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:52.824016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5d739aff-4666-4e31-a413-8ac30d416d75 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:52.825302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5d739aff-4666-4e31-a413-8ac30d416d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:52.834044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:52.926935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 685/1378] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:52.971892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36703c56-ad36-4bbd-82eb-0bf3ed18e69c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:52.973532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-36703c56-ad36-4bbd-82eb-0bf3ed18e69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:53.037085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:53.134763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36703c56-ad36-4bbd-82eb-0bf3ed18e69c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:53.290842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b2863-2d20-4c91-b8bc-5846d49533f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:53.291839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2863-2d20-4c91-b8bc-5846d49533f1 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:53.292263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2863-2d20-4c91-b8bc-5846d49533f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:53.292690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2863-2d20-4c91-b8bc-5846d49533f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:53.294563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-632b2863-2d20-4c91-b8bc-5846d49533f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:53.321238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:53.400879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b2863-2d20-4c91-b8bc-5846d49533f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:53.402497 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b2863-2d20-4c91-b8bc-5846d49533f1 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:53.420387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 694/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:55.732934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0684516-a2d4-4652-a508-2ee1d24d2c7c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:55.733500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0684516-a2d4-4652-a508-2ee1d24d2c7c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:55.733500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0684516-a2d4-4652-a508-2ee1d24d2c7c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:55.734969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 686/1380] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:55.740456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae46a1-3cf6-411c-9b0a-cf3e4fbc1d0c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:55.740893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae46a1-3cf6-411c-9b0a-cf3e4fbc1d0c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:55.741027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae46a1-3cf6-411c-9b0a-cf3e4fbc1d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:55.809094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-e1ae46a1-3cf6-411c-9b0a-cf3e4fbc1d0c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:55.810198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e1ae46a1-3cf6-411c-9b0a-cf3e4fbc1d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:55.906034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:55.913115 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 695/1381] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:00:55.956756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0684516-a2d4-4652-a508-2ee1d24d2c7c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:55.959289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f0684516-a2d4-4652-a508-2ee1d24d2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:56.105130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:56.118481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0684516-a2d4-4652-a508-2ee1d24d2c7c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:56.251771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e984905-c5e4-4710-bb08-5a5beccea8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:56.251918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e984905-c5e4-4710-bb08-5a5beccea8a6 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:56.252164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e984905-c5e4-4710-bb08-5a5beccea8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:56.252436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e984905-c5e4-4710-bb08-5a5beccea8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:56.254165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7e984905-c5e4-4710-bb08-5a5beccea8a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:56.352881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e984905-c5e4-4710-bb08-5a5beccea8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:56.354669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e984905-c5e4-4710-bb08-5a5beccea8a6 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:56.367005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:56.373318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 687/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:00:58.702759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a61f-b33d-4945-888a-3d8b8be1eae7 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:58.703285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a61f-b33d-4945-888a-3d8b8be1eae7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:58.703480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a61f-b33d-4945-888a-3d8b8be1eae7 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:58.705413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 696/1383] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:00:58.712359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303ca04-b40f-4dcd-86fe-3f80d0beeecd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:58.712828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303ca04-b40f-4dcd-86fe-3f80d0beeecd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:58.712946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303ca04-b40f-4dcd-86fe-3f80d0beeecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:58.782720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1303ca04-b40f-4dcd-86fe-3f80d0beeecd None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:00:58.783946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1303ca04-b40f-4dcd-86fe-3f80d0beeecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:58.881087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 688/1384] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:00:58.933619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093a61f-b33d-4945-888a-3d8b8be1eae7 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:00:58.935178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f093a61f-b33d-4945-888a-3d8b8be1eae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:59.081040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093a61f-b33d-4945-888a-3d8b8be1eae7 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:00:59.153928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:59.203938 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b047de-f09c-4ea0-9398-c4cea7a3c981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:00:59.204577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b047de-f09c-4ea0-9398-c4cea7a3c981 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:00:59.204890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b047de-f09c-4ea0-9398-c4cea7a3c981 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:00:59.205169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b047de-f09c-4ea0-9398-c4cea7a3c981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:00:59.206830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b3b047de-f09c-4ea0-9398-c4cea7a3c981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:00:59.304354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b047de-f09c-4ea0-9398-c4cea7a3c981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:00:59.306014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b047de-f09c-4ea0-9398-c4cea7a3c981 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:00:59.324878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 697/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:01.349018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6ac3-8aa1-4e29-be7e-383417adb75d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:01.350309 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6ac3-8aa1-4e29-be7e-383417adb75d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:01.350309 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6ac3-8aa1-4e29-be7e-383417adb75d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:01.351541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 689/1386] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:01:01.357034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785c150-2a04-48d1-a3fd-cbc789ccc296 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:01.357514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785c150-2a04-48d1-a3fd-cbc789ccc296 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:01.357613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785c150-2a04-48d1-a3fd-cbc789ccc296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:01.434299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b785c150-2a04-48d1-a3fd-cbc789ccc296 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:01.435778 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b785c150-2a04-48d1-a3fd-cbc789ccc296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:01.479474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:01.563282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 698/1387] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:01.609104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca6ac3-8aa1-4e29-be7e-383417adb75d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:01.610595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4ca6ac3-8aa1-4e29-be7e-383417adb75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:01.689463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:01.762554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca6ac3-8aa1-4e29-be7e-383417adb75d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:01.878513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2c30c-5ef3-4a7a-8573-73f71069ba54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:01.879135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c30c-5ef3-4a7a-8573-73f71069ba54 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:01.879414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c30c-5ef3-4a7a-8573-73f71069ba54 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:01.879684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c30c-5ef3-4a7a-8573-73f71069ba54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:01.881402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2cd2c30c-5ef3-4a7a-8573-73f71069ba54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:01.922083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:01.975076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2c30c-5ef3-4a7a-8573-73f71069ba54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:01.976606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2c30c-5ef3-4a7a-8573-73f71069ba54 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:01.994975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 690/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:04.190704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2701a-d7c9-40cd-b824-ad7fb3fbaf5f None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:04.191147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2701a-d7c9-40cd-b824-ad7fb3fbaf5f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:04.191259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2701a-d7c9-40cd-b824-ad7fb3fbaf5f None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:04.192700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 699/1389] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:04.198429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ed9ef-229b-4848-9edb-81fd40ff40f2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:04.198836 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ed9ef-229b-4848-9edb-81fd40ff40f2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:04.198982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ed9ef-229b-4848-9edb-81fd40ff40f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:04.264375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-165ed9ef-229b-4848-9edb-81fd40ff40f2 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:04.265620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-165ed9ef-229b-4848-9edb-81fd40ff40f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:04.363637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 691/1390] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:04.414967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2701a-d7c9-40cd-b824-ad7fb3fbaf5f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:04.416531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-59e2701a-d7c9-40cd-b824-ad7fb3fbaf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:04.563641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2701a-d7c9-40cd-b824-ad7fb3fbaf5f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:04.582482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:04.678866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298ad8-3a11-4504-8d9e-2fae9ea6f7ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:04.679480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298ad8-3a11-4504-8d9e-2fae9ea6f7ea service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:04.679758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298ad8-3a11-4504-8d9e-2fae9ea6f7ea service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:04.680024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298ad8-3a11-4504-8d9e-2fae9ea6f7ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:04.681668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f7298ad8-3a11-4504-8d9e-2fae9ea6f7ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:04.769707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298ad8-3a11-4504-8d9e-2fae9ea6f7ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:04.771813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298ad8-3a11-4504-8d9e-2fae9ea6f7ea service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:04.790666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 700/1391] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:04.998445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32221368-dd89-4604-bb44-13364e10a831 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:04.998737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32221368-dd89-4604-bb44-13364e10a831 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:04.999019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32221368-dd89-4604-bb44-13364e10a831 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:05.000431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 692/1392] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:05.005899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2016-c1b9-4e37-9c5d-90cd561ae92b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:05.006196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2016-c1b9-4e37-9c5d-90cd561ae92b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:05.006486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2016-c1b9-4e37-9c5d-90cd561ae92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:05.035131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:05.084136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-348d2016-c1b9-4e37-9c5d-90cd561ae92b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:05.085382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-348d2016-c1b9-4e37-9c5d-90cd561ae92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:05.191592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 701/1393] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:05.247175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4496f-637e-45e5-8ac7-4c3320875d1c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:05.247621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4496f-637e-45e5-8ac7-4c3320875d1c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:05.247730 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4496f-637e-45e5-8ac7-4c3320875d1c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:05.249260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 693/1394] 10.222.0.67 () {54 vars in 966 bytes} [Thu Jul 28 18:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:05.254201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4754139-fcbb-4745-98d9-bca05d540141 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:05.254493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4754139-fcbb-4745-98d9-bca05d540141 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:05.254772 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4754139-fcbb-4745-98d9-bca05d540141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:05.333131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a4754139-fcbb-4745-98d9-bca05d540141 None None] MFA Rules not processed for user `18138af1ea504faca84b0cc2034ddd36`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:05.334897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a4754139-fcbb-4745-98d9-bca05d540141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:05.375558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:05.412740 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 702/1395] 10.222.0.67 () {58 vars in 1063 bytes} [Thu Jul 28 18:01:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:05.419985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4496f-637e-45e5-8ac7-4c3320875d1c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:05.421580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f1d4496f-637e-45e5-8ac7-4c3320875d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:05.435031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:05.527668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4496f-637e-45e5-8ac7-4c3320875d1c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:05.601750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a5e00-561e-4402-a91a-f8771a4fd5bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18138af1ea504faca84b0cc2034ddd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:05.602367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a5e00-561e-4402-a91a-f8771a4fd5bb service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:05.602648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a5e00-561e-4402-a91a-f8771a4fd5bb service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:05.602923 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a5e00-561e-4402-a91a-f8771a4fd5bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:05.604540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-af2a5e00-561e-4402-a91a-f8771a4fd5bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:05.673921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:05.719874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a5e00-561e-4402-a91a-f8771a4fd5bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:05.721350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a5e00-561e-4402-a91a-f8771a4fd5bb service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:05.739184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 694/1396] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:06.985070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80cdd1-603a-4590-b716-f87413228fed None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:06.985600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80cdd1-603a-4590-b716-f87413228fed None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:06.985710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80cdd1-603a-4590-b716-f87413228fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:07.010524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280530ef-e251-4b28-a0b1-abb4e215ad5a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:07.011083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280530ef-e251-4b28-a0b1-abb4e215ad5a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:07.011083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280530ef-e251-4b28-a0b1-abb4e215ad5a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:07.012433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 695/1397] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:01:07.017463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74c869-fd1b-407f-b47c-7f78c967c93e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:07.017751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74c869-fd1b-407f-b47c-7f78c967c93e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:07.018028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74c869-fd1b-407f-b47c-7f78c967c93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:07.054955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9c80cdd1-603a-4590-b716-f87413228fed None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:07.056176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9c80cdd1-603a-4590-b716-f87413228fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:07.089946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4a74c869-fd1b-407f-b47c-7f78c967c93e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:07.091155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4a74c869-fd1b-407f-b47c-7f78c967c93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:07.144157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 703/1398] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:01:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:07.193095 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 696/1399] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:07.195939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e49a3e-83fc-4d57-aa1c-b416cfa6c3aa None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:07.196220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e49a3e-83fc-4d57-aa1c-b416cfa6c3aa None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:07.196487 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e49a3e-83fc-4d57-aa1c-b416cfa6c3aa None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:07.197894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 704/1400] 10.222.0.67 () {54 vars in 943 bytes} [Thu Jul 28 18:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:07.203901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a1d01-99f4-4bdb-bd4d-c6fd95c6695c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:07.204184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a1d01-99f4-4bdb-bd4d-c6fd95c6695c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:07.204456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a1d01-99f4-4bdb-bd4d-c6fd95c6695c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:07.230757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:07.237844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e49a3e-83fc-4d57-aa1c-b416cfa6c3aa None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:07.242924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-47e49a3e-83fc-4d57-aa1c-b416cfa6c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:07.281184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8b9a1d01-99f4-4bdb-bd4d-c6fd95c6695c None None] MFA Rules not processed for user `38bd83f5a0bc4e7ea5cde1972c44503b`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:07.283069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8b9a1d01-99f4-4bdb-bd4d-c6fd95c6695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:07.302879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:07.388925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e49a3e-83fc-4d57-aa1c-b416cfa6c3aa None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:07.389690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 697/1401] 10.222.0.67 () {58 vars in 1040 bytes} [Thu Jul 28 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:01:07.400046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a1d01-99f4-4bdb-bd4d-c6fd95c6695c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:07.409452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a1d01-99f4-4bdb-bd4d-c6fd95c6695c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:07.482188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:07.504043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1db5-a52c-464d-8cec-cded3a530152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:07.504672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1db5-a52c-464d-8cec-cded3a530152 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:07.505042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1db5-a52c-464d-8cec-cded3a530152 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:07.505950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1db5-a52c-464d-8cec-cded3a530152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:07.507586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-71bd1db5-a52c-464d-8cec-cded3a530152 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:07.517053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85afe8-7c9e-45a8-8483-c5b3fcd3f5fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:07.517824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85afe8-7c9e-45a8-8483-c5b3fcd3f5fb service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:07.518212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85afe8-7c9e-45a8-8483-c5b3fcd3f5fb service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:07.518597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85afe8-7c9e-45a8-8483-c5b3fcd3f5fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:07.520228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6f85afe8-7c9e-45a8-8483-c5b3fcd3f5fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:07.526211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:07.600805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1db5-a52c-464d-8cec-cded3a530152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:07.602424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1db5-a52c-464d-8cec-cded3a530152 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:07.604602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85afe8-7c9e-45a8-8483-c5b3fcd3f5fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:07.606219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85afe8-7c9e-45a8-8483-c5b3fcd3f5fb service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:07.615534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 698/1402] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:01:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:01:07.620932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 705/1403] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:09.903841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b2c1-f83b-4620-8a33-46a007bdbf87 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:09.921543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b2c1-f83b-4620-8a33-46a007bdbf87 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:09.921543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b2c1-f83b-4620-8a33-46a007bdbf87 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:09.921543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 699/1404] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:01:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:09.921851 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1392-9527-4cf8-aa20-77b8f302112e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:09.921851 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1392-9527-4cf8-aa20-77b8f302112e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:09.921851 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1392-9527-4cf8-aa20-77b8f302112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:09.994892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7fce1392-9527-4cf8-aa20-77b8f302112e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:09.996110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7fce1392-9527-4cf8-aa20-77b8f302112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:10.114637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:10.136807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 706/1405] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:10.175749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b2c1-f83b-4620-8a33-46a007bdbf87 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:10.177148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6373b2c1-f83b-4620-8a33-46a007bdbf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:10.302319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:10.359543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b2c1-f83b-4620-8a33-46a007bdbf87 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:10.488532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74939f4-76d3-4804-8b9d-9281f4b79fce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:10.496648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74939f4-76d3-4804-8b9d-9281f4b79fce service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:10.496648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74939f4-76d3-4804-8b9d-9281f4b79fce service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:10.496648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74939f4-76d3-4804-8b9d-9281f4b79fce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:10.496648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f74939f4-76d3-4804-8b9d-9281f4b79fce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:10.592648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:10.593938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74939f4-76d3-4804-8b9d-9281f4b79fce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:10.595683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74939f4-76d3-4804-8b9d-9281f4b79fce service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:10.618013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 700/1406] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:12.862037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ee3e-23d5-4349-b3aa-0c09436e3f0e None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:12.862621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ee3e-23d5-4349-b3aa-0c09436e3f0e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:12.862621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ee3e-23d5-4349-b3aa-0c09436e3f0e None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:12.863989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 707/1407] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:12.870917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1d39d-fa93-4789-96b6-be731388fe5e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:12.872471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1d39d-fa93-4789-96b6-be731388fe5e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:12.872758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1d39d-fa93-4789-96b6-be731388fe5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:12.950379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0cf1d39d-fa93-4789-96b6-be731388fe5e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:12.951871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0cf1d39d-fa93-4789-96b6-be731388fe5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:13.064832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 701/1408] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:13.103614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ee3e-23d5-4349-b3aa-0c09436e3f0e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:13.105158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ea59ee3e-23d5-4349-b3aa-0c09436e3f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:13.281798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ee3e-23d5-4349-b3aa-0c09436e3f0e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:13.369263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:13.432195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39317db-767d-4f8a-ae09-544bf2bfacf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:13.432852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39317db-767d-4f8a-ae09-544bf2bfacf2 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:13.433178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39317db-767d-4f8a-ae09-544bf2bfacf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:13.433451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39317db-767d-4f8a-ae09-544bf2bfacf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:13.435186 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b39317db-767d-4f8a-ae09-544bf2bfacf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:13.538414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39317db-767d-4f8a-ae09-544bf2bfacf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:13.540046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39317db-767d-4f8a-ae09-544bf2bfacf2 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:13.560413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 708/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:23.054397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=79 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:23.557425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=64 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:31.698420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a356a-e6c6-46ed-950e-0fa876dfdda3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.699005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a356a-e6c6-46ed-950e-0fa876dfdda3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.699005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a356a-e6c6-46ed-950e-0fa876dfdda3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.700323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 702/1410] 10.222.0.67 () {54 vars in 918 bytes} [Thu Jul 28 18:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:31.705614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722e478-5164-44a7-8d17-5c7b02844c11 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.706021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722e478-5164-44a7-8d17-5c7b02844c11 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.706153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722e478-5164-44a7-8d17-5c7b02844c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.780670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c722e478-5164-44a7-8d17-5c7b02844c11 None None] MFA Rules not processed for user `4dded05b23a0469785e3a7bedf1cf851`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:31.781901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c722e478-5164-44a7-8d17-5c7b02844c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:31.887777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 709/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jul 28 18:01:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:31.902389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1d559-07b6-489d-a22f-c27c79b15b87 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.909084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1d559-07b6-489d-a22f-c27c79b15b87 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.909084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1d559-07b6-489d-a22f-c27c79b15b87 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.909084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 703/1412] 10.222.0.67 () {54 vars in 918 bytes} [Thu Jul 28 18:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:31.909375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007f21-15cf-4863-b286-928d200270dd None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:31.909375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007f21-15cf-4863-b286-928d200270dd None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:31.909594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007f21-15cf-4863-b286-928d200270dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:31.983831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:31.986764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-19007f21-15cf-4863-b286-928d200270dd None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:31.987971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-19007f21-15cf-4863-b286-928d200270dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:32.103390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 710/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jul 28 18:01:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:34.587445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0e73-68aa-4f05-a635-bff7126ad382 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:34.587445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0e73-68aa-4f05-a635-bff7126ad382 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:34.587445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0e73-68aa-4f05-a635-bff7126ad382 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:34.588757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:34.594122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2655ee-ec44-46ed-b862-d0f87b5fa72a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:34.594531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2655ee-ec44-46ed-b862-d0f87b5fa72a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:34.594709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2655ee-ec44-46ed-b862-d0f87b5fa72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:34.659580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ae2655ee-ec44-46ed-b862-d0f87b5fa72a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:34.660807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ae2655ee-ec44-46ed-b862-d0f87b5fa72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:34.715431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:34.756770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:34.799989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f0e73-68aa-4f05-a635-bff7126ad382 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:34.801509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a98f0e73-68aa-4f05-a635-bff7126ad382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:34.944705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f0e73-68aa-4f05-a635-bff7126ad382 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:35.017488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:35.056980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abd3d7-37a7-4ccd-8289-5bf30dfe7497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:35.057597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd3d7-37a7-4ccd-8289-5bf30dfe7497 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:35.057912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd3d7-37a7-4ccd-8289-5bf30dfe7497 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:35.058186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd3d7-37a7-4ccd-8289-5bf30dfe7497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:35.059805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a0abd3d7-37a7-4ccd-8289-5bf30dfe7497 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:35.147915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abd3d7-37a7-4ccd-8289-5bf30dfe7497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:35.149531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abd3d7-37a7-4ccd-8289-5bf30dfe7497 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:35.168033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 705/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:36.072959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a98e6f-c9c8-43e6-b085-1bb282607fb7 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:36.073559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a98e6f-c9c8-43e6-b085-1bb282607fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:36.073559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a98e6f-c9c8-43e6-b085-1bb282607fb7 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:36.074922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:36.079967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a542be-b04b-40f7-951c-62b4c9dc4eb1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:36.080402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a542be-b04b-40f7-951c-62b4c9dc4eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:36.080508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a542be-b04b-40f7-951c-62b4c9dc4eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:36.158289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d8a542be-b04b-40f7-951c-62b4c9dc4eb1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:36.159507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d8a542be-b04b-40f7-951c-62b4c9dc4eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:36.187120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:36.257217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:36.407184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a98e6f-c9c8-43e6-b085-1bb282607fb7 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:36.408618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-45a98e6f-c9c8-43e6-b085-1bb282607fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:36.554613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a98e6f-c9c8-43e6-b085-1bb282607fb7 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:36.595178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:36.668365 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c665a10-b592-4226-bd2c-19be37e30be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:36.669011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c665a10-b592-4226-bd2c-19be37e30be2 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:36.669295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c665a10-b592-4226-bd2c-19be37e30be2 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:36.669569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c665a10-b592-4226-bd2c-19be37e30be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:36.671190 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8c665a10-b592-4226-bd2c-19be37e30be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:36.758226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c665a10-b592-4226-bd2c-19be37e30be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:36.759811 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c665a10-b592-4226-bd2c-19be37e30be2 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:36.781016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 713/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:37.675928 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e84e-6636-458b-8065-4552cee4de27 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:37.676490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e84e-6636-458b-8065-4552cee4de27 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:37.676490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e84e-6636-458b-8065-4552cee4de27 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:37.678061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:37.683032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f219f27-54f3-4cab-9688-d4df0a4fafe6 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:37.683435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f219f27-54f3-4cab-9688-d4df0a4fafe6 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:37.683580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f219f27-54f3-4cab-9688-d4df0a4fafe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:37.737989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:37.759628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7f219f27-54f3-4cab-9688-d4df0a4fafe6 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:37.760956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7f219f27-54f3-4cab-9688-d4df0a4fafe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:37.858011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:38.010754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e84e-6636-458b-8065-4552cee4de27 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:38.012227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9ba1e84e-6636-458b-8065-4552cee4de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:38.162065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e84e-6636-458b-8065-4552cee4de27 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:38.174333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:38.273694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55f007-7e27-4fad-af81-d7de4e2539a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:38.274229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55f007-7e27-4fad-af81-d7de4e2539a8 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:38.274507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55f007-7e27-4fad-af81-d7de4e2539a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:38.274779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55f007-7e27-4fad-af81-d7de4e2539a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:38.276388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6c55f007-7e27-4fad-af81-d7de4e2539a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:38.363715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55f007-7e27-4fad-af81-d7de4e2539a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:38.365887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55f007-7e27-4fad-af81-d7de4e2539a8 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:38.383565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 708/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:39.251802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953297-437a-446a-9dbc-f59a17802609 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:39.252349 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953297-437a-446a-9dbc-f59a17802609 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:39.252349 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953297-437a-446a-9dbc-f59a17802609 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:39.253738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:39.259238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb6b87-58f9-4680-867e-797d8e9751ca None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:39.259639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb6b87-58f9-4680-867e-797d8e9751ca None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:39.259825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb6b87-58f9-4680-867e-797d8e9751ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:39.279287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:39.336078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-11cb6b87-58f9-4680-867e-797d8e9751ca None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:39.337478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-11cb6b87-58f9-4680-867e-797d8e9751ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:39.432387 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:39.584184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1953297-437a-446a-9dbc-f59a17802609 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:39.585760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e1953297-437a-446a-9dbc-f59a17802609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:39.695454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:39.733528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1953297-437a-446a-9dbc-f59a17802609 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:39.845083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c48b72-03ef-434c-ae3d-f1c49f19252c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:39.845695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c48b72-03ef-434c-ae3d-f1c49f19252c service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:39.845971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c48b72-03ef-434c-ae3d-f1c49f19252c service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:39.846237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c48b72-03ef-434c-ae3d-f1c49f19252c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:39.847857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a0c48b72-03ef-434c-ae3d-f1c49f19252c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:39.921760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:39.935204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c48b72-03ef-434c-ae3d-f1c49f19252c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:39.936977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c48b72-03ef-434c-ae3d-f1c49f19252c service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:39.955562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 716/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:40.814551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3a2aa-e3d2-4b36-849b-d4aea706f055 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:40.815139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3a2aa-e3d2-4b36-849b-d4aea706f055 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:40.815139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3a2aa-e3d2-4b36-849b-d4aea706f055 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:40.816444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:40.825385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df1af-fd39-459e-8943-842f3da54cea None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:40.825818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df1af-fd39-459e-8943-842f3da54cea None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:40.825946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df1af-fd39-459e-8943-842f3da54cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:40.900719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-084df1af-fd39-459e-8943-842f3da54cea None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:40.901949 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-084df1af-fd39-459e-8943-842f3da54cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:40.995753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:41.150909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3a2aa-e3d2-4b36-849b-d4aea706f055 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:41.152340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-78e3a2aa-e3d2-4b36-849b-d4aea706f055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:41.235094 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:41.298246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3a2aa-e3d2-4b36-849b-d4aea706f055 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:41.409623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee2820-dff1-47dd-9ce8-edd718811f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:41.410192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee2820-dff1-47dd-9ce8-edd718811f68 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:41.410473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee2820-dff1-47dd-9ce8-edd718811f68 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:41.410746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee2820-dff1-47dd-9ce8-edd718811f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:41.412910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-40ee2820-dff1-47dd-9ce8-edd718811f68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:41.460983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:41.501278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee2820-dff1-47dd-9ce8-edd718811f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:41.502879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee2820-dff1-47dd-9ce8-edd718811f68 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:41.521448 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 711/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:42.375336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bf105-1f70-42a2-8e7d-c55083007ab6 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.375865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bf105-1f70-42a2-8e7d-c55083007ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.375865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bf105-1f70-42a2-8e7d-c55083007ab6 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.377173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:42.382226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60d08f-2d49-43dd-b420-463a3f5e678f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.382637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60d08f-2d49-43dd-b420-463a3f5e678f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.382770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60d08f-2d49-43dd-b420-463a3f5e678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.459144 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-de60d08f-2d49-43dd-b420-463a3f5e678f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:42.460345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-de60d08f-2d49-43dd-b420-463a3f5e678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:42.555422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:42.720479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bf105-1f70-42a2-8e7d-c55083007ab6 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:42.722029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c86bf105-1f70-42a2-8e7d-c55083007ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:42.770061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:42.869475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bf105-1f70-42a2-8e7d-c55083007ab6 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:42.981617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8072725-f5a7-4c9b-8cd4-8876115a33d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:42.982152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8072725-f5a7-4c9b-8cd4-8876115a33d8 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:42.982431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8072725-f5a7-4c9b-8cd4-8876115a33d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:42.982702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8072725-f5a7-4c9b-8cd4-8876115a33d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:42.984321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e8072725-f5a7-4c9b-8cd4-8876115a33d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:42.991713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:43.074673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8072725-f5a7-4c9b-8cd4-8876115a33d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:43.076260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8072725-f5a7-4c9b-8cd4-8876115a33d8 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:43.095401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 719/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:44.034641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befad09-6194-46d9-8cd2-34d8e4e78dc3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:44.035186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befad09-6194-46d9-8cd2-34d8e4e78dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:44.035186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befad09-6194-46d9-8cd2-34d8e4e78dc3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:44.036619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:44.041709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f84b9-4fb7-4eec-b547-86001e97ac1f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:44.042139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f84b9-4fb7-4eec-b547-86001e97ac1f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:44.042257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f84b9-4fb7-4eec-b547-86001e97ac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:44.118049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-611f84b9-4fb7-4eec-b547-86001e97ac1f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:44.119286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-611f84b9-4fb7-4eec-b547-86001e97ac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:44.186514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:44.216110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:44.369107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befad09-6194-46d9-8cd2-34d8e4e78dc3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:44.370516 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6befad09-6194-46d9-8cd2-34d8e4e78dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:44.387721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:44.512718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befad09-6194-46d9-8cd2-34d8e4e78dc3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:44.597231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:44.622627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657059ae-7ed2-4040-a71a-e995e3f52392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:44.623230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657059ae-7ed2-4040-a71a-e995e3f52392 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:44.623512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657059ae-7ed2-4040-a71a-e995e3f52392 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:44.623791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657059ae-7ed2-4040-a71a-e995e3f52392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:44.625463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-657059ae-7ed2-4040-a71a-e995e3f52392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:44.717377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657059ae-7ed2-4040-a71a-e995e3f52392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:44.718977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657059ae-7ed2-4040-a71a-e995e3f52392 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:44.737019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 714/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:45.645015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a12c5-443e-489d-88ea-24b5dc1d2113 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.646118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a12c5-443e-489d-88ea-24b5dc1d2113 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.646353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a12c5-443e-489d-88ea-24b5dc1d2113 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.647710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:45.652588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece82e9-2c18-46e2-97ab-5f7e62e32f76 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:45.652999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece82e9-2c18-46e2-97ab-5f7e62e32f76 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:45.653164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece82e9-2c18-46e2-97ab-5f7e62e32f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:45.847686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6ece82e9-2c18-46e2-97ab-5f7e62e32f76 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:45.848887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6ece82e9-2c18-46e2-97ab-5f7e62e32f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:45.889463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:45.944106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:46.093586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a12c5-443e-489d-88ea-24b5dc1d2113 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:46.095087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bc8a12c5-443e-489d-88ea-24b5dc1d2113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:46.242804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a12c5-443e-489d-88ea-24b5dc1d2113 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:46.297052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:46.356250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a8b66-84b8-4695-b451-7e074dddc588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:46.356899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a8b66-84b8-4695-b451-7e074dddc588 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:46.357182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a8b66-84b8-4695-b451-7e074dddc588 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:46.357458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a8b66-84b8-4695-b451-7e074dddc588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:46.359072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f63a8b66-84b8-4695-b451-7e074dddc588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:46.453198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a8b66-84b8-4695-b451-7e074dddc588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:46.453198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a8b66-84b8-4695-b451-7e074dddc588 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:46.469668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 722/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:47.396184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61229fce-f84f-4771-b437-5265e3483d9c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.396776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61229fce-f84f-4771-b437-5265e3483d9c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.396776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61229fce-f84f-4771-b437-5265e3483d9c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.398168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:47.403211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441eed-33dc-4f79-93ca-5e55d94c7ed7 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.408014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441eed-33dc-4f79-93ca-5e55d94c7ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.408014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b441eed-33dc-4f79-93ca-5e55d94c7ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.478724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-5b441eed-33dc-4f79-93ca-5e55d94c7ed7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:47.479842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5b441eed-33dc-4f79-93ca-5e55d94c7ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.481882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:47.574743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:47.725389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61229fce-f84f-4771-b437-5265e3483d9c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:47.726934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-61229fce-f84f-4771-b437-5265e3483d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:47.870432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61229fce-f84f-4771-b437-5265e3483d9c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:47.897455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:47.982691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bd5d2-8e51-4cad-9c66-c5c9603e2c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:47.983308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bd5d2-8e51-4cad-9c66-c5c9603e2c86 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:47.983589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bd5d2-8e51-4cad-9c66-c5c9603e2c86 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:47.983861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bd5d2-8e51-4cad-9c66-c5c9603e2c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:47.985522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5f8bd5d2-8e51-4cad-9c66-c5c9603e2c86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:48.072521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bd5d2-8e51-4cad-9c66-c5c9603e2c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:48.074133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bd5d2-8e51-4cad-9c66-c5c9603e2c86 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:48.091813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 717/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:50.012189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0effc6-6d6e-44e2-b311-1c3a7c172a60 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:50.012762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0effc6-6d6e-44e2-b311-1c3a7c172a60 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:50.012762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0effc6-6d6e-44e2-b311-1c3a7c172a60 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:50.014122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:01:50.019281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7671d-9789-44b2-a26f-ac0ffd45b6d4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:50.019707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7671d-9789-44b2-a26f-ac0ffd45b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:50.019864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7671d-9789-44b2-a26f-ac0ffd45b6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:50.061285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:50.085986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e9b7671d-9789-44b2-a26f-ac0ffd45b6d4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:50.087165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e9b7671d-9789-44b2-a26f-ac0ffd45b6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:50.183881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:50.223621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0effc6-6d6e-44e2-b311-1c3a7c172a60 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:50.225173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5b0effc6-6d6e-44e2-b311-1c3a7c172a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:50.329117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0effc6-6d6e-44e2-b311-1c3a7c172a60 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:50.361579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:50.404479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd089441-d2b0-4d61-a800-b01248eb2641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:50.405135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd089441-d2b0-4d61-a800-b01248eb2641 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:50.405420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd089441-d2b0-4d61-a800-b01248eb2641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:50.405691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd089441-d2b0-4d61-a800-b01248eb2641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:50.407308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-dd089441-d2b0-4d61-a800-b01248eb2641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:50.517450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd089441-d2b0-4d61-a800-b01248eb2641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:50.518906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd089441-d2b0-4d61-a800-b01248eb2641 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:50.537488 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 725/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:52.709395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c816332-aa6a-4c25-8172-43fc3e9cbcef None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:52.709937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c816332-aa6a-4c25-8172-43fc3e9cbcef None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:52.710060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c816332-aa6a-4c25-8172-43fc3e9cbcef None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:52.711356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:52.716465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d264d-4313-4461-8b43-5c0bb54eb06a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:52.716878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d264d-4313-4461-8b43-5c0bb54eb06a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:52.717057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d264d-4313-4461-8b43-5c0bb54eb06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:52.782521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ec3d264d-4313-4461-8b43-5c0bb54eb06a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:52.783761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ec3d264d-4313-4461-8b43-5c0bb54eb06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:52.797736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:52.885346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:52.922686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c816332-aa6a-4c25-8172-43fc3e9cbcef None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:52.924194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9c816332-aa6a-4c25-8172-43fc3e9cbcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:53.028727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c816332-aa6a-4c25-8172-43fc3e9cbcef None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:53.040542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:53.102041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aec238-b5f8-44b6-99a7-07c9e38cf439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:53.102646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aec238-b5f8-44b6-99a7-07c9e38cf439 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:53.102917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aec238-b5f8-44b6-99a7-07c9e38cf439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:53.103203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aec238-b5f8-44b6-99a7-07c9e38cf439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:53.104862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-05aec238-b5f8-44b6-99a7-07c9e38cf439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:53.222678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aec238-b5f8-44b6-99a7-07c9e38cf439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:53.224598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aec238-b5f8-44b6-99a7-07c9e38cf439 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:53.242543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 720/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:55.625975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24cddf-e6f3-45e6-a192-d0f8bff087ed None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:55.626536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24cddf-e6f3-45e6-a192-d0f8bff087ed None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:55.626536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24cddf-e6f3-45e6-a192-d0f8bff087ed None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:55.627913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:55.633681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bc8ae-fc4b-4c6f-8138-a86634325f6b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:55.634077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bc8ae-fc4b-4c6f-8138-a86634325f6b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:55.634237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bc8ae-fc4b-4c6f-8138-a86634325f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:55.681372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:55.699309 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-554bc8ae-fc4b-4c6f-8138-a86634325f6b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:55.700524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-554bc8ae-fc4b-4c6f-8138-a86634325f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:55.796109 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:55.840300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24cddf-e6f3-45e6-a192-d0f8bff087ed None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:55.841879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fe24cddf-e6f3-45e6-a192-d0f8bff087ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:55.945396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24cddf-e6f3-45e6-a192-d0f8bff087ed None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:55.985587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:56.018203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd8c4-3925-40b6-aaad-0fdf441cf485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:56.018819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd8c4-3925-40b6-aaad-0fdf441cf485 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:56.019129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd8c4-3925-40b6-aaad-0fdf441cf485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:56.019601 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd8c4-3925-40b6-aaad-0fdf441cf485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:56.022346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-027fd8c4-3925-40b6-aaad-0fdf441cf485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:56.130591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd8c4-3925-40b6-aaad-0fdf441cf485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:56.132024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd8c4-3925-40b6-aaad-0fdf441cf485 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:56.149763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 728/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:01:58.329822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daec52b-46ec-499b-ad0f-74748eb63e2f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:58.330386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daec52b-46ec-499b-ad0f-74748eb63e2f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:58.330386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daec52b-46ec-499b-ad0f-74748eb63e2f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:58.331718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:01:58.337178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2334ee1-de35-448f-a4cd-3cdbef0b3146 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:58.337623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2334ee1-de35-448f-a4cd-3cdbef0b3146 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:58.337767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2334ee1-de35-448f-a4cd-3cdbef0b3146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:58.403028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f2334ee1-de35-448f-a4cd-3cdbef0b3146 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:01:58.404225 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f2334ee1-de35-448f-a4cd-3cdbef0b3146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:58.424504 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:58.498808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:01:58.537767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daec52b-46ec-499b-ad0f-74748eb63e2f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:01:58.539282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6daec52b-46ec-499b-ad0f-74748eb63e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:58.641882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daec52b-46ec-499b-ad0f-74748eb63e2f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:01:58.661341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:58.713232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb273b8-d4f1-4457-90cb-bcc50fa3789a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:01:58.713771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb273b8-d4f1-4457-90cb-bcc50fa3789a service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:01:58.714044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb273b8-d4f1-4457-90cb-bcc50fa3789a service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:01:58.714306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb273b8-d4f1-4457-90cb-bcc50fa3789a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:01:58.715878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cdb273b8-d4f1-4457-90cb-bcc50fa3789a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:01:58.819817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb273b8-d4f1-4457-90cb-bcc50fa3789a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:01:58.821248 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb273b8-d4f1-4457-90cb-bcc50fa3789a service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:01:58.839156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 723/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:00.904516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560deba-c10c-4307-99a3-0aff5285db22 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:00.905094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560deba-c10c-4307-99a3-0aff5285db22 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:00.905094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560deba-c10c-4307-99a3-0aff5285db22 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:00.906377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:00.911832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284984c-cb14-4ef0-b531-236e45f55a6e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:00.912259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284984c-cb14-4ef0-b531-236e45f55a6e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:00.912411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284984c-cb14-4ef0-b531-236e45f55a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:00.975307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:00.977939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4284984c-cb14-4ef0-b531-236e45f55a6e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:00.979140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4284984c-cb14-4ef0-b531-236e45f55a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:01.074880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:01.113542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560deba-c10c-4307-99a3-0aff5285db22 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:01.115134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9560deba-c10c-4307-99a3-0aff5285db22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:01.233270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560deba-c10c-4307-99a3-0aff5285db22 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:01.280933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:01.305886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ced4f6-29bb-4a39-9375-716b8cb20cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:01.306502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ced4f6-29bb-4a39-9375-716b8cb20cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:01.306783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ced4f6-29bb-4a39-9375-716b8cb20cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:01.307058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ced4f6-29bb-4a39-9375-716b8cb20cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:01.308677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-94ced4f6-29bb-4a39-9375-716b8cb20cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:01.417251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ced4f6-29bb-4a39-9375-716b8cb20cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:01.418678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ced4f6-29bb-4a39-9375-716b8cb20cc2 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:01.437590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 731/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:03.534825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a4afc-d478-4218-a721-8b186bf4f6e0 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:03.535353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a4afc-d478-4218-a721-8b186bf4f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:03.535353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a4afc-d478-4218-a721-8b186bf4f6e0 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:03.537303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:03.542754 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07ae80-0f89-409a-a7cc-ccd7c69ce75e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:03.545095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07ae80-0f89-409a-a7cc-ccd7c69ce75e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:03.545095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07ae80-0f89-409a-a7cc-ccd7c69ce75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:03.727766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2d07ae80-0f89-409a-a7cc-ccd7c69ce75e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:03.728999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2d07ae80-0f89-409a-a7cc-ccd7c69ce75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:03.757927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:03.824413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:03.862137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a4afc-d478-4218-a721-8b186bf4f6e0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:03.863641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-945a4afc-d478-4218-a721-8b186bf4f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:03.966155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a4afc-d478-4218-a721-8b186bf4f6e0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:03.998353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:04.046306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065b2d9-9594-465c-91e2-b662e4d1da66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:04.046961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065b2d9-9594-465c-91e2-b662e4d1da66 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:04.047265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065b2d9-9594-465c-91e2-b662e4d1da66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:04.047538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065b2d9-9594-465c-91e2-b662e4d1da66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:04.049164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e065b2d9-9594-465c-91e2-b662e4d1da66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:04.157133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065b2d9-9594-465c-91e2-b662e4d1da66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:04.158483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065b2d9-9594-465c-91e2-b662e4d1da66 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:04.179077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 726/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:06.227136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754b5ac-438b-4198-89d8-9d351fda62a4 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.227684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754b5ac-438b-4198-89d8-9d351fda62a4 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.227684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754b5ac-438b-4198-89d8-9d351fda62a4 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.229072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:06.234603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f06836-8767-4e56-9119-890741701ba5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.235007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f06836-8767-4e56-9119-890741701ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.235266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f06836-8767-4e56-9119-890741701ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.302818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f2f06836-8767-4e56-9119-890741701ba5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:06.304914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f2f06836-8767-4e56-9119-890741701ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:06.313634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:06.408579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:06.446552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754b5ac-438b-4198-89d8-9d351fda62a4 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:06.448119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8754b5ac-438b-4198-89d8-9d351fda62a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:06.553599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754b5ac-438b-4198-89d8-9d351fda62a4 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:06.609274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:06.626686 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a41eeb-93dd-47cb-b4c4-dc0fd23d7130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:06.627302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41eeb-93dd-47cb-b4c4-dc0fd23d7130 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:06.627580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41eeb-93dd-47cb-b4c4-dc0fd23d7130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:06.627850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41eeb-93dd-47cb-b4c4-dc0fd23d7130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:06.630083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-16a41eeb-93dd-47cb-b4c4-dc0fd23d7130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:06.748071 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a41eeb-93dd-47cb-b4c4-dc0fd23d7130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:06.749451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a41eeb-93dd-47cb-b4c4-dc0fd23d7130 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:06.767451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 734/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:08.815204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768103-5512-45f4-a427-aeb6483b44e3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.815782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768103-5512-45f4-a427-aeb6483b44e3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.815782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768103-5512-45f4-a427-aeb6483b44e3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.817204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:08.822284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcae41-f63e-446d-b82d-c74c8d49a22c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:08.822672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcae41-f63e-446d-b82d-c74c8d49a22c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:08.822829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcae41-f63e-446d-b82d-c74c8d49a22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:08.888515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-4edcae41-f63e-446d-b82d-c74c8d49a22c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:08.889653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4edcae41-f63e-446d-b82d-c74c8d49a22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:08.927185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:08.986420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:09.024909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0768103-5512-45f4-a427-aeb6483b44e3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:09.026480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c0768103-5512-45f4-a427-aeb6483b44e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:09.128947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0768103-5512-45f4-a427-aeb6483b44e3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:09.167372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:09.202689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba22466-ca84-413b-9886-b328cecadb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:09.203536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba22466-ca84-413b-9886-b328cecadb08 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:09.204001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba22466-ca84-413b-9886-b328cecadb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:09.204620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba22466-ca84-413b-9886-b328cecadb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:09.206302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0ba22466-ca84-413b-9886-b328cecadb08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:09.312219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba22466-ca84-413b-9886-b328cecadb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:09.313728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba22466-ca84-413b-9886-b328cecadb08 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:09.331856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 729/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:11.337689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c31a-66cc-4a18-86d7-5dd3fac2d720 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:11.338270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c31a-66cc-4a18-86d7-5dd3fac2d720 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:11.338270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c31a-66cc-4a18-86d7-5dd3fac2d720 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:11.339582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:11.344707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4d859-4ad3-4e88-8184-26bb3db4288a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:11.345165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4d859-4ad3-4e88-8184-26bb3db4288a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:11.345258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4d859-4ad3-4e88-8184-26bb3db4288a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:11.409640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-66d4d859-4ad3-4e88-8184-26bb3db4288a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:11.411412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-66d4d859-4ad3-4e88-8184-26bb3db4288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:11.433782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:11.510480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:11.547459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60c31a-66cc-4a18-86d7-5dd3fac2d720 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:11.549045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4e60c31a-66cc-4a18-86d7-5dd3fac2d720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:11.650778 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60c31a-66cc-4a18-86d7-5dd3fac2d720 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:11.715860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:11.722260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826e8a4-50f0-4e95-a86d-68ab94bd9504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:11.722895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826e8a4-50f0-4e95-a86d-68ab94bd9504 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:11.723729 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826e8a4-50f0-4e95-a86d-68ab94bd9504 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:11.724002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826e8a4-50f0-4e95-a86d-68ab94bd9504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:11.725627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e826e8a4-50f0-4e95-a86d-68ab94bd9504 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:11.831748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826e8a4-50f0-4e95-a86d-68ab94bd9504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:11.833702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826e8a4-50f0-4e95-a86d-68ab94bd9504 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:11.851752 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 737/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:13.881877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d39937-4cd8-4653-b48f-fe4b92aaeee4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:13.882450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d39937-4cd8-4653-b48f-fe4b92aaeee4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:13.882450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d39937-4cd8-4653-b48f-fe4b92aaeee4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:13.883842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:13.889225 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017541fd-760c-42ae-bbad-50ec67ecbf72 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:13.889607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017541fd-760c-42ae-bbad-50ec67ecbf72 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:13.889764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017541fd-760c-42ae-bbad-50ec67ecbf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:13.965927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-017541fd-760c-42ae-bbad-50ec67ecbf72 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:13.968283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-017541fd-760c-42ae-bbad-50ec67ecbf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:14.024901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:14.074291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:14.113135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d39937-4cd8-4653-b48f-fe4b92aaeee4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:14.115260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-14d39937-4cd8-4653-b48f-fe4b92aaeee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:14.222929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d39937-4cd8-4653-b48f-fe4b92aaeee4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:14.272581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:14.298768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69790ac3-15da-454d-9590-ae67c26b0157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:14.299381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69790ac3-15da-454d-9590-ae67c26b0157 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:14.299654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69790ac3-15da-454d-9590-ae67c26b0157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:14.299918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69790ac3-15da-454d-9590-ae67c26b0157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:14.302139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-69790ac3-15da-454d-9590-ae67c26b0157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:14.416131 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69790ac3-15da-454d-9590-ae67c26b0157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:14.417759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69790ac3-15da-454d-9590-ae67c26b0157 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:14.438389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 732/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:24.077921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=22 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:24.435943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=66 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:33.945518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc8fe-298a-4fed-bc53-b004975ce97c None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:33.953182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc8fe-298a-4fed-bc53-b004975ce97c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:33.953182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc8fe-298a-4fed-bc53-b004975ce97c None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:33.953182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 739/1471] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:33.953496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80de9b-e524-4a38-b9d0-257fc91923ef None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:33.953496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80de9b-e524-4a38-b9d0-257fc91923ef None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:33.953979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80de9b-e524-4a38-b9d0-257fc91923ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:34.020036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-da80de9b-e524-4a38-b9d0-257fc91923ef None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:34.021283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-da80de9b-e524-4a38-b9d0-257fc91923ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:34.125244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 733/1472] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:34.209072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddd15c-5d9c-4a90-9089-6f5c1808c388 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:34.209356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddd15c-5d9c-4a90-9089-6f5c1808c388 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:34.209631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddd15c-5d9c-4a90-9089-6f5c1808c388 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:34.210958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 740/1473] 10.222.0.67 () {54 vars in 966 bytes} [Thu Jul 28 18:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:34.215949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ffa90-3bc1-4793-96f4-ce8eb25cd943 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:34.216231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ffa90-3bc1-4793-96f4-ce8eb25cd943 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:34.216502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ffa90-3bc1-4793-96f4-ce8eb25cd943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:34.290257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-802ffa90-3bc1-4793-96f4-ce8eb25cd943 None None] MFA Rules not processed for user `18138af1ea504faca84b0cc2034ddd36`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:34.294747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-802ffa90-3bc1-4793-96f4-ce8eb25cd943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:34.311949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:34.366681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 734/1474] 10.222.0.67 () {58 vars in 1063 bytes} [Thu Jul 28 18:02:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:34.374276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddd15c-5d9c-4a90-9089-6f5c1808c388 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:34.375777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-96ddd15c-5d9c-4a90-9089-6f5c1808c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:34.480764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddd15c-5d9c-4a90-9089-6f5c1808c388 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:34.553981 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bde908-4a82-47b2-ad42-1cce12d0bd58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18138af1ea504faca84b0cc2034ddd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:34.554598 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bde908-4a82-47b2-ad42-1cce12d0bd58 service glance] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:34.554877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bde908-4a82-47b2-ad42-1cce12d0bd58 service glance] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:34.555155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bde908-4a82-47b2-ad42-1cce12d0bd58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:34.556764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-48bde908-4a82-47b2-ad42-1cce12d0bd58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:34.609759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:34.664159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bde908-4a82-47b2-ad42-1cce12d0bd58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:34.665652 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bde908-4a82-47b2-ad42-1cce12d0bd58 service glance] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:34.684200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 741/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:02:36.782449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952210f-aad8-42dc-8524-2379b30721df None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:36.783023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952210f-aad8-42dc-8524-2379b30721df None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:36.783023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952210f-aad8-42dc-8524-2379b30721df None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:36.784364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 735/1476] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:36.789746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424ad8a-26de-4652-9f49-6c0d554e2144 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:36.790129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424ad8a-26de-4652-9f49-6c0d554e2144 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:36.790306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424ad8a-26de-4652-9f49-6c0d554e2144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:36.855374 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f424ad8a-26de-4652-9f49-6c0d554e2144 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:36.856567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f424ad8a-26de-4652-9f49-6c0d554e2144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:36.954341 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 742/1477] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:36.978136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952210f-aad8-42dc-8524-2379b30721df None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:36.979650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4952210f-aad8-42dc-8524-2379b30721df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:37.103281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952210f-aad8-42dc-8524-2379b30721df None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:37.151284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:37.195539 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5781d65-4e55-4d96-86d1-2b2b345737db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:37.196177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5781d65-4e55-4d96-86d1-2b2b345737db admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:37.196472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5781d65-4e55-4d96-86d1-2b2b345737db admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:37.196986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5781d65-4e55-4d96-86d1-2b2b345737db admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:37.197845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5781d65-4e55-4d96-86d1-2b2b345737db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:37.199905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-f5781d65-4e55-4d96-86d1-2b2b345737db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:02:37.199905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 28 18:02:37.199905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: Jul 28 18:02:37.201068 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5781d65-4e55-4d96-86d1-2b2b345737db admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:37.219900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 736/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 28 18:02:36 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:02:39.218126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa430-4778-461f-b428-9a1eb59e77f9 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:39.218689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa430-4778-461f-b428-9a1eb59e77f9 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:39.218689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa430-4778-461f-b428-9a1eb59e77f9 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:39.219997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 743/1479] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:39.225718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33184f03-aaca-4849-b242-8b5444172dd6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:39.226125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33184f03-aaca-4849-b242-8b5444172dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:39.226283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33184f03-aaca-4849-b242-8b5444172dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:39.291554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-33184f03-aaca-4849-b242-8b5444172dd6 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:39.292743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-33184f03-aaca-4849-b242-8b5444172dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:39.386232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 737/1480] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:02:39.429625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa430-4778-461f-b428-9a1eb59e77f9 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:39.431123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-062aa430-4778-461f-b428-9a1eb59e77f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:39.440892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:39.606376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa430-4778-461f-b428-9a1eb59e77f9 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:39.684655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:39.722380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b92724-abc7-4f33-809c-1bc6b5b01d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:39.723316 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92724-abc7-4f33-809c-1bc6b5b01d24 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:39.723608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92724-abc7-4f33-809c-1bc6b5b01d24 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:39.724020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92724-abc7-4f33-809c-1bc6b5b01d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:39.725968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-60b92724-abc7-4f33-809c-1bc6b5b01d24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:39.814486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92724-abc7-4f33-809c-1bc6b5b01d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:39.816083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92724-abc7-4f33-809c-1bc6b5b01d24 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:39.835683 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 744/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:42.021019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f67f-7b1a-4dd4-b108-713ca934ea2f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:42.021549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f67f-7b1a-4dd4-b108-713ca934ea2f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:42.021549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f67f-7b1a-4dd4-b108-713ca934ea2f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:42.022962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 738/1482] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:42.028188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b306ee7-4594-470b-8589-4eb8f41089ec None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:42.028630 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b306ee7-4594-470b-8589-4eb8f41089ec None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:42.028736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b306ee7-4594-470b-8589-4eb8f41089ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:42.095978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-6b306ee7-4594-470b-8589-4eb8f41089ec None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:42.097232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6b306ee7-4594-470b-8589-4eb8f41089ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:42.144092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:42.194495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 745/1483] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:42.230552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0f67f-7b1a-4dd4-b108-713ca934ea2f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:42.232070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d7d0f67f-7b1a-4dd4-b108-713ca934ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:42.256118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:42.335027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0f67f-7b1a-4dd4-b108-713ca934ea2f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:42.407301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c657ef6-b0a2-44ef-ab7d-c57f31731976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:42.407953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c657ef6-b0a2-44ef-ab7d-c57f31731976 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:42.408284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c657ef6-b0a2-44ef-ab7d-c57f31731976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:42.408557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c657ef6-b0a2-44ef-ab7d-c57f31731976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:42.410207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4c657ef6-b0a2-44ef-ab7d-c57f31731976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:42.483013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:42.517107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c657ef6-b0a2-44ef-ab7d-c57f31731976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:42.518528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c657ef6-b0a2-44ef-ab7d-c57f31731976 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:42.537321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 739/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:44.598334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923e19-f718-4056-9c08-922a43d57a49 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:44.598856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923e19-f718-4056-9c08-922a43d57a49 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:44.598856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923e19-f718-4056-9c08-922a43d57a49 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:44.600147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 746/1485] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:44.605324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eab9f-749a-49f0-b283-187f1d5a4b23 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:44.605772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eab9f-749a-49f0-b283-187f1d5a4b23 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:44.605949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eab9f-749a-49f0-b283-187f1d5a4b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:44.671292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-577eab9f-749a-49f0-b283-187f1d5a4b23 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:44.672486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-577eab9f-749a-49f0-b283-187f1d5a4b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:44.772925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 740/1486] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:02:44.806552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923e19-f718-4056-9c08-922a43d57a49 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:44.808080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2b923e19-f718-4056-9c08-922a43d57a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:44.913247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923e19-f718-4056-9c08-922a43d57a49 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:44.989689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:44.991461 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db4152-df7b-41b0-930b-7f9189045cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:44.992081 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4152-df7b-41b0-930b-7f9189045cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:44.992364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4152-df7b-41b0-930b-7f9189045cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:44.992642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db4152-df7b-41b0-930b-7f9189045cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:44.994396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d3db4152-df7b-41b0-930b-7f9189045cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:45.103903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db4152-df7b-41b0-930b-7f9189045cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:45.105401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db4152-df7b-41b0-930b-7f9189045cb7 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:45.123775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 747/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:47.213359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dd2ba-5b9e-41e0-94da-2c5b20d810d2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:47.213837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dd2ba-5b9e-41e0-94da-2c5b20d810d2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:47.213947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dd2ba-5b9e-41e0-94da-2c5b20d810d2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:47.215279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 741/1488] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:47.220513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc030a9-d4f9-4d18-b822-00ba15590ab5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:47.220929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc030a9-d4f9-4d18-b822-00ba15590ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:47.221140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc030a9-d4f9-4d18-b822-00ba15590ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:47.288016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ebc030a9-d4f9-4d18-b822-00ba15590ab5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:47.289286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ebc030a9-d4f9-4d18-b822-00ba15590ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:47.341884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:47.385310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 748/1489] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:47.426283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dd2ba-5b9e-41e0-94da-2c5b20d810d2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:47.427729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-999dd2ba-5b9e-41e0-94da-2c5b20d810d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:47.462837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:47.529508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dd2ba-5b9e-41e0-94da-2c5b20d810d2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:47.606645 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6c9c5-577e-4e2b-9397-66b39bdfecba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:47.607260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6c9c5-577e-4e2b-9397-66b39bdfecba service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:47.607538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6c9c5-577e-4e2b-9397-66b39bdfecba service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:47.607804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6c9c5-577e-4e2b-9397-66b39bdfecba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:47.609448 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dde6c9c5-577e-4e2b-9397-66b39bdfecba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:47.689345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:47.717373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6c9c5-577e-4e2b-9397-66b39bdfecba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:47.718792 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6c9c5-577e-4e2b-9397-66b39bdfecba service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:47.736372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 742/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:02:50.141528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856ef42-326a-4b14-a3c6-7476d8b8c78a None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:50.142134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856ef42-326a-4b14-a3c6-7476d8b8c78a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:50.142134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856ef42-326a-4b14-a3c6-7476d8b8c78a None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:50.143494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 749/1491] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 28 18:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:02:50.149370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f07eb-34eb-4a02-b485-e759153417cc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:50.149824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f07eb-34eb-4a02-b485-e759153417cc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:50.150007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f07eb-34eb-4a02-b485-e759153417cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:50.215678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9a0f07eb-34eb-4a02-b485-e759153417cc None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:02:50.216904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9a0f07eb-34eb-4a02-b485-e759153417cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:50.310855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 743/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 28 18:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:02:50.351978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856ef42-326a-4b14-a3c6-7476d8b8c78a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:02:50.353547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2856ef42-326a-4b14-a3c6-7476d8b8c78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:50.457903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856ef42-326a-4b14-a3c6-7476d8b8c78a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:02:50.531063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e422642-88e6-4951-b59b-8d9406a1afbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:02:50.531680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422642-88e6-4951-b59b-8d9406a1afbb service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:02:50.531959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422642-88e6-4951-b59b-8d9406a1afbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:02:50.532231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422642-88e6-4951-b59b-8d9406a1afbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:02:50.533897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1e422642-88e6-4951-b59b-8d9406a1afbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:02:50.543542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:50.641321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e422642-88e6-4951-b59b-8d9406a1afbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:02:50.642767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e422642-88e6-4951-b59b-8d9406a1afbb service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:02:50.662261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 750/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:03:00.309082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=82 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:00.663514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=50 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:28.067315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ccd8-9a71-48ee-9a97-ed1ba95e963c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:28.067876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ccd8-9a71-48ee-9a97-ed1ba95e963c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:28.067876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4ccd8-9a71-48ee-9a97-ed1ba95e963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:28.141953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d7b4ccd8-9a71-48ee-9a97-ed1ba95e963c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:28.143658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d7b4ccd8-9a71-48ee-9a97-ed1ba95e963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:28.247344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 744/1494] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:28.255702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db8d57-b8d8-43ab-b3c9-97cecbdab13b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:28.256222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db8d57-b8d8-43ab-b3c9-97cecbdab13b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:28.256222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db8d57-b8d8-43ab-b3c9-97cecbdab13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:28.332132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f8db8d57-b8d8-43ab-b3c9-97cecbdab13b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:28.333264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f8db8d57-b8d8-43ab-b3c9-97cecbdab13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:28.427509 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 751/1495] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:28.432205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4ccd8-9a71-48ee-9a97-ed1ba95e963c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:28.433441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d7b4ccd8-9a71-48ee-9a97-ed1ba95e963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:28.445706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4ccd8-9a71-48ee-9a97-ed1ba95e963c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:28.506288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:28.545423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:28.546043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:28.546339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:28.546613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:28.547303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:04:28.547601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:28.548723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:28.548723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 28 18:04:28.548723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: Jul 28 18:04:28.550216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:28.561829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 745/1496] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:04:28.570084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db8d57-b8d8-43ab-b3c9-97cecbdab13b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:28.579130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db8d57-b8d8-43ab-b3c9-97cecbdab13b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:28.639254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:28.673332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:28.673946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:28.674254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:28.675115 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:28.675764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:28.677511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WARNING py.warnings [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:28.677511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: warnings.warn(msg) Jul 28 18:04:28.677511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: Jul 28 18:04:28.679030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:28.844882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 752/1497] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:04:28 2022] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:04:28.849631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:28.851135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:28.884072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d065335-2d9b-44c8-a847-2614958fa592 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:28.976906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:28.977524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:28.977804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:28.978076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:28.978766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:28.979752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:28.979752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 28 18:04:28.979752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: Jul 28 18:04:28.980984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:29.117464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 746/1498] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:04:28 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:04:29.121779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:29.123268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:29.185135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527152-35ab-4511-9b35-b04fff0c1284 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:29.267391 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:29.277959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:29.278574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:29.278853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:29.279124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:29.279812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:29.280855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WARNING py.warnings [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:29.280855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: warnings.warn(msg) Jul 28 18:04:29.280855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: Jul 28 18:04:29.281726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:29.293907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 753/1499] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:04:29.298086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:29.299591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:29.310879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1f4a9-80eb-43e0-8c03-244d80c34ed2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:29.336510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:29.405041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaa4e0-cb31-4547-8f1e-772ddd60b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:29.405652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaa4e0-cb31-4547-8f1e-772ddd60b308 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:29.405927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaa4e0-cb31-4547-8f1e-772ddd60b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:29.406193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaa4e0-cb31-4547-8f1e-772ddd60b308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:29.406879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaa4e0-cb31-4547-8f1e-772ddd60b308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:29.407876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-fceaa4e0-cb31-4547-8f1e-772ddd60b308 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:29.407876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 28 18:04:29.407876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: Jul 28 18:04:29.408754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaa4e0-cb31-4547-8f1e-772ddd60b308 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:29.421377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 747/1500] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:04:29.425709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:29.427254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:29.460860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40475d7d-474c-4dea-9621-48318110db22 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:29.553887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4640734-8335-4202-99cb-6ca0ddeb226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:29.554475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4640734-8335-4202-99cb-6ca0ddeb226f admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:29.554761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4640734-8335-4202-99cb-6ca0ddeb226f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:29.555031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4640734-8335-4202-99cb-6ca0ddeb226f admin admin] PATH_INFO: `/v3/projects/9369c1ce1f5a4d5c9196c100d190ba8e/users/ec1dfd704fdc46b88ed623567da53959/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:29.576311 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4640734-8335-4202-99cb-6ca0ddeb226f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9369c1ce1f5a4d5c9196c100d190ba8e, user_id=ec1dfd704fdc46b88ed623567da53959, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:29.577357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WARNING py.warnings [None req-c4640734-8335-4202-99cb-6ca0ddeb226f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:29.577357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: warnings.warn(msg) Jul 28 18:04:29.577357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: Jul 28 18:04:29.579281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4640734-8335-4202-99cb-6ca0ddeb226f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:29.668179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 754/1501] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:04:29 2022] PUT /identity/v3/projects/9369c1ce1f5a4d5c9196c100d190ba8e/users/ec1dfd704fdc46b88ed623567da53959/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:04:29.681515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674901-371b-482c-b389-d82d75cab11c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:29.681796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674901-371b-482c-b389-d82d75cab11c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:29.682065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09674901-371b-482c-b389-d82d75cab11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:29.737765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-09674901-371b-482c-b389-d82d75cab11c None None] MFA Rules not processed for user `ec1dfd704fdc46b88ed623567da53959`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:29.738958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-09674901-371b-482c-b389-d82d75cab11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:29.813481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 748/1502] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:29.827157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ea644-43b7-4384-91c5-2dda126229cc None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:29.827448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ea644-43b7-4384-91c5-2dda126229cc None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:29.827727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ea644-43b7-4384-91c5-2dda126229cc None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:29.829148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 755/1503] 10.222.0.67 () {54 vars in 964 bytes} [Thu Jul 28 18:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:04:29.834022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892378d-069b-4430-a924-f377302a1c19 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:29.834307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892378d-069b-4430-a924-f377302a1c19 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:29.834579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892378d-069b-4430-a924-f377302a1c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:29.866583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:29.910683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1892378d-069b-4430-a924-f377302a1c19 None None] MFA Rules not processed for user `3a4c879f65c24edea2404cb74ac37025`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:29.911889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1892378d-069b-4430-a924-f377302a1c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:29.987481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 749/1504] 10.222.0.67 () {58 vars in 1061 bytes} [Thu Jul 28 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:29.995369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ea644-43b7-4384-91c5-2dda126229cc None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:29.997434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-503ea644-43b7-4384-91c5-2dda126229cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:30.047079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:30.099917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ea644-43b7-4384-91c5-2dda126229cc None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:30.172809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:30.173466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:30.173726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:30.173998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:30.175605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:30.282250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:30.283726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:30.287247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:30.301853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 756/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:04:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:04:30.382007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176a063-d1d8-491a-a281-7042754437af None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:30.382007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176a063-d1d8-491a-a281-7042754437af None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:30.382007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176a063-d1d8-491a-a281-7042754437af None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:30.382007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 750/1506] 10.222.0.67 () {52 vars in 830 bytes} [Thu Jul 28 18:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:04:30.383926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:30.385168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:30.484610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af898-d3ad-4210-b31f-bccc1066d243 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:30.579899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:30.581496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:30.581905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:30.582227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] PATH_INFO: `/v3/users/ec1dfd704fdc46b88ed623567da53959` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:30.594451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1dfd704fdc46b88ed623567da53959)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:30.595475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WARNING py.warnings [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:30.595475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: warnings.warn(msg) Jul 28 18:04:30.595475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: Jul 28 18:04:30.597327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:30.606885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:30.828467 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1dfd704fdc46b88ed623567da53959'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:30.829024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1dfd704fdc46b88ed623567da53959'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:30.918597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1dfd704fdc46b88ed623567da53959'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:30.919044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1dfd704fdc46b88ed623567da53959'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:30.937535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1dfd704fdc46b88ed623567da53959'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:30.957230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 757/1507] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:04:30 2022] DELETE /identity/v3/users/ec1dfd704fdc46b88ed623567da53959 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:04:30.961818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68243-e07a-46da-8dd5-705af525a62f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:30.962107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68243-e07a-46da-8dd5-705af525a62f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:30.962389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68243-e07a-46da-8dd5-705af525a62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:31.017895 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-37b68243-e07a-46da-8dd5-705af525a62f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:04:31.019066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-37b68243-e07a-46da-8dd5-705af525a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:31.093418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:31.105319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 751/1508] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:04:31.115452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:31.116661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:31.218939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8b37d-997e-4996-b9ea-efad6d3e5b63 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:31.271959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:31.290803 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981212d7-2f3b-4392-9006-b85fd81a41c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:31.291420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981212d7-2f3b-4392-9006-b85fd81a41c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:31.291698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981212d7-2f3b-4392-9006-b85fd81a41c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:31.291968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981212d7-2f3b-4392-9006-b85fd81a41c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:31.293636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-981212d7-2f3b-4392-9006-b85fd81a41c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:31.402106 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981212d7-2f3b-4392-9006-b85fd81a41c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:31.403548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981212d7-2f3b-4392-9006-b85fd81a41c2 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:31.422681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 758/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:04:31.955176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b68243-e07a-46da-8dd5-705af525a62f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:04:31.957160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-37b68243-e07a-46da-8dd5-705af525a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:04:31.968817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b68243-e07a-46da-8dd5-705af525a62f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:04:32.077181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:04:32.077826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:04:32.078113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:04:32.078380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] PATH_INFO: `/v3/projects/9369c1ce1f5a4d5c9196c100d190ba8e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:04:32.089354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9369c1ce1f5a4d5c9196c100d190ba8e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:04:32.090379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:32.090379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 28 18:04:32.090379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: Jul 28 18:04:32.091589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:04:32.220392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9369c1ce1f5a4d5c9196c100d190ba8e', 'request_id': 'req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:32.311346 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9369c1ce1f5a4d5c9196c100d190ba8e', 'request_id': 'req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:32.318170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9369c1ce1f5a4d5c9196c100d190ba8e', 'request_id': 'req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:32.349759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] The token cache is being invalidate because project 9369c1ce1f5a4d5c9196c100d190ba8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:04:32.350047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:32.350478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0fbae8f6-2db9-4ab6-8070-acd3bf2cfd93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:04:32.353326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 752/1510] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:04:31 2022] DELETE /identity/v3/projects/9369c1ce1f5a4d5c9196c100d190ba8e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:04:41.420389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=62 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:42.347703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:21.825405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d3b8b-f3f7-44ea-9535-1071b3dc9348 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.826008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d3b8b-f3f7-44ea-9535-1071b3dc9348 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.826008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d3b8b-f3f7-44ea-9535-1071b3dc9348 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.827316 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:06:21.832282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412cc6-7158-40fb-a465-b7fdada3ad45 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:21.833012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412cc6-7158-40fb-a465-b7fdada3ad45 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:21.833141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412cc6-7158-40fb-a465-b7fdada3ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:21.913001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2a412cc6-7158-40fb-a465-b7fdada3ad45 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:21.914211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2a412cc6-7158-40fb-a465-b7fdada3ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:22.024368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:22.182791 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d3b8b-f3f7-44ea-9535-1071b3dc9348 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:22.185085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cf7d3b8b-f3f7-44ea-9535-1071b3dc9348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:22.304616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d3b8b-f3f7-44ea-9535-1071b3dc9348 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:22.310089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5f210-74f5-4590-9164-30a01a4a425f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:22.310705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f210-74f5-4590-9164-30a01a4a425f service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:22.310987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f210-74f5-4590-9164-30a01a4a425f service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:22.311259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5f210-74f5-4590-9164-30a01a4a425f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:22.319222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f210-74f5-4590-9164-30a01a4a425f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:22.320833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5f210-74f5-4590-9164-30a01a4a425f service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:22.330060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 760/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:23.162941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec207d-1ff4-4ff9-81ea-007d8a5c1d0e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.163566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec207d-1ff4-4ff9-81ea-007d8a5c1d0e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.163566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec207d-1ff4-4ff9-81ea-007d8a5c1d0e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.164908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:06:23.170123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64843e99-40db-4a6e-aebf-1c9a6e231427 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.170593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64843e99-40db-4a6e-aebf-1c9a6e231427 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.171218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64843e99-40db-4a6e-aebf-1c9a6e231427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.190579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-64843e99-40db-4a6e-aebf-1c9a6e231427 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:23.192324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-64843e99-40db-4a6e-aebf-1c9a6e231427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:23.200084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:23.360640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec207d-1ff4-4ff9-81ea-007d8a5c1d0e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:23.375556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec207d-1ff4-4ff9-81ea-007d8a5c1d0e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:23.381661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd541c8-2219-4b65-ac8b-e227848e2775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:23.382265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd541c8-2219-4b65-ac8b-e227848e2775 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.382544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd541c8-2219-4b65-ac8b-e227848e2775 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.382817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd541c8-2219-4b65-ac8b-e227848e2775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.390868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd541c8-2219-4b65-ac8b-e227848e2775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:23.392439 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd541c8-2219-4b65-ac8b-e227848e2775 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:23.401869 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 755/1516] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:23.877562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3e561-6fa9-4c9b-8021-449a3f8132c6 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.877766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3e561-6fa9-4c9b-8021-449a3f8132c6 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.878034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3e561-6fa9-4c9b-8021-449a3f8132c6 None None] PATH_INFO: `/v3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.879352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 762/1517] 10.222.0.102 () {54 vars in 926 bytes} [Thu Jul 28 18:06:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:06:23.885619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17253c-9420-4049-b88a-c739a5bac85c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:23.885903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17253c-9420-4049-b88a-c739a5bac85c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:23.886176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17253c-9420-4049-b88a-c739a5bac85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:23.949314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7a17253c-9420-4049-b88a-c739a5bac85c None None] MFA Rules not processed for user `4dded05b23a0469785e3a7bedf1cf851`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:23.950504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7a17253c-9420-4049-b88a-c739a5bac85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:23.967259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:24.022154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 756/1518] 10.222.0.102 () {58 vars in 1016 bytes} [Thu Jul 28 18:06:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:33.185819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=56 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:33.545013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc16100-4631-485f-868c-c0e45138fb21 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.545218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc16100-4631-485f-868c-c0e45138fb21 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.545495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc16100-4631-485f-868c-c0e45138fb21 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.546831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 763/1519] 10.222.0.67 () {54 vars in 961 bytes} [Thu Jul 28 18:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:06:33.551798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b8b6-419e-46a7-a51c-664eae2684a3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.552253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b8b6-419e-46a7-a51c-664eae2684a3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.552358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b8b6-419e-46a7-a51c-664eae2684a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.572944 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-22c0b8b6-419e-46a7-a51c-664eae2684a3 None None] MFA Rules not processed for user `4dded05b23a0469785e3a7bedf1cf851`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:33.574150 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-22c0b8b6-419e-46a7-a51c-664eae2684a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:33.583527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 757/1520] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Jul 28 18:06:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:33.591158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc16100-4631-485f-868c-c0e45138fb21 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:33.607629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc16100-4631-485f-868c-c0e45138fb21 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:33.612479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349428a-319d-46ce-aea8-1fdec09cfe77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:33.613679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349428a-319d-46ce-aea8-1fdec09cfe77 service placement] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:33.613955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349428a-319d-46ce-aea8-1fdec09cfe77 service placement] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:33.614224 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349428a-319d-46ce-aea8-1fdec09cfe77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:33.622422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349428a-319d-46ce-aea8-1fdec09cfe77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:33.623990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349428a-319d-46ce-aea8-1fdec09cfe77 service placement] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:33.633910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 764/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:34.637805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b8a3-371e-41b1-b744-7741183a7e3b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:34.638315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b8a3-371e-41b1-b744-7741183a7e3b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:34.638436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b8a3-371e-41b1-b744-7741183a7e3b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:34.639739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:06:34.644678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add532e-4e3b-4e89-8099-1aa94f0c702c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:34.645144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add532e-4e3b-4e89-8099-1aa94f0c702c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:34.645297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add532e-4e3b-4e89-8099-1aa94f0c702c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:34.671166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9add532e-4e3b-4e89-8099-1aa94f0c702c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:34.672334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9add532e-4e3b-4e89-8099-1aa94f0c702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:34.681104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:34.836048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204b8a3-371e-41b1-b744-7741183a7e3b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:34.850851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204b8a3-371e-41b1-b744-7741183a7e3b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:34.856264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e363fca-5e46-42de-8830-10587f753970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:34.856966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e363fca-5e46-42de-8830-10587f753970 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:34.857256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e363fca-5e46-42de-8830-10587f753970 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:34.857521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e363fca-5e46-42de-8830-10587f753970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:34.866212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e363fca-5e46-42de-8830-10587f753970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:34.867771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e363fca-5e46-42de-8830-10587f753970 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:34.877154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 759/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:35.692403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e39ccc-c199-49e7-a7c7-df17daa353ab None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:35.692993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e39ccc-c199-49e7-a7c7-df17daa353ab None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:35.692993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e39ccc-c199-49e7-a7c7-df17daa353ab None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:35.694323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 18:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:06:35.699156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c231fc-5ee5-453f-8af9-316fa640d700 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:35.699604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c231fc-5ee5-453f-8af9-316fa640d700 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:35.699741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c231fc-5ee5-453f-8af9-316fa640d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:35.719014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b4c231fc-5ee5-453f-8af9-316fa640d700 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:35.720200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b4c231fc-5ee5-453f-8af9-316fa640d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:35.728460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 18:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:35.886489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e39ccc-c199-49e7-a7c7-df17daa353ab None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:35.901145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e39ccc-c199-49e7-a7c7-df17daa353ab None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:35.906500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64114-29d0-4da9-bed1-9c1f9619528c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:35.907096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64114-29d0-4da9-bed1-9c1f9619528c service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:35.907377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64114-29d0-4da9-bed1-9c1f9619528c service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:35.907650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64114-29d0-4da9-bed1-9c1f9619528c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:35.916265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa64114-29d0-4da9-bed1-9c1f9619528c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:35.917877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa64114-29d0-4da9-bed1-9c1f9619528c service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:35.927093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 767/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:39.902326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385426ae-11ff-43ac-a727-815da517953d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.902888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385426ae-11ff-43ac-a727-815da517953d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.902888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385426ae-11ff-43ac-a727-815da517953d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.904246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:06:39.909522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bc076-6f91-4a8c-bb6e-85e62bfd764c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:39.909956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bc076-6f91-4a8c-bb6e-85e62bfd764c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:39.910059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bc076-6f91-4a8c-bb6e-85e62bfd764c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:39.929936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-318bc076-6f91-4a8c-bb6e-85e62bfd764c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:39.931124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-318bc076-6f91-4a8c-bb6e-85e62bfd764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:39.938865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:40.017474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385426ae-11ff-43ac-a727-815da517953d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:40.019834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-385426ae-11ff-43ac-a727-815da517953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:40.097598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385426ae-11ff-43ac-a727-815da517953d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:40.101396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd273d-b662-4c24-b7bf-d72801be602b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:40.102013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd273d-b662-4c24-b7bf-d72801be602b service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:40.102293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd273d-b662-4c24-b7bf-d72801be602b service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:40.102567 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd273d-b662-4c24-b7bf-d72801be602b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:40.111612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd273d-b662-4c24-b7bf-d72801be602b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:40.113602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd273d-b662-4c24-b7bf-d72801be602b service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:40.122748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 762/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:42.180898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce24a0-da82-4d70-983f-5681261c6db1 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.181388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce24a0-da82-4d70-983f-5681261c6db1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.181495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce24a0-da82-4d70-983f-5681261c6db1 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.182826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:06:42.188051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0b86-0620-4bf0-bed3-ec4c4a771717 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.188481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0b86-0620-4bf0-bed3-ec4c4a771717 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.188579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0b86-0620-4bf0-bed3-ec4c4a771717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.210112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9cca0b86-0620-4bf0-bed3-ec4c4a771717 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:42.213007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9cca0b86-0620-4bf0-bed3-ec4c4a771717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:42.219017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:42.256173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce24a0-da82-4d70-983f-5681261c6db1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:42.266954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce24a0-da82-4d70-983f-5681261c6db1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:42.271305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275f170-7b35-4f32-90d2-ac354116d14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:42.271900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275f170-7b35-4f32-90d2-ac354116d14d service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:42.272177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275f170-7b35-4f32-90d2-ac354116d14d service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:42.272448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275f170-7b35-4f32-90d2-ac354116d14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:42.281671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275f170-7b35-4f32-90d2-ac354116d14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:42.293429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275f170-7b35-4f32-90d2-ac354116d14d service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:42.294448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 770/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:06:45.876727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62ac4c-b547-453f-88c9-f47a59f4f74f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:45.877348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62ac4c-b547-453f-88c9-f47a59f4f74f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:45.877348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62ac4c-b547-453f-88c9-f47a59f4f74f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:45.878891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:06:45.884144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70f8c-6376-437c-8b98-8570ef7bce83 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:45.884595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70f8c-6376-437c-8b98-8570ef7bce83 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:45.884696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70f8c-6376-437c-8b98-8570ef7bce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:45.905049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8be70f8c-6376-437c-8b98-8570ef7bce83 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:45.906241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8be70f8c-6376-437c-8b98-8570ef7bce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:45.914765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:06:46.228655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62ac4c-b547-453f-88c9-f47a59f4f74f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:46.230346 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9d62ac4c-b547-453f-88c9-f47a59f4f74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:46.300303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:46.313569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62ac4c-b547-453f-88c9-f47a59f4f74f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:46.317900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f0a6d-d60d-4f9c-b67e-65e2eb3638f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:46.318552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f0a6d-d60d-4f9c-b67e-65e2eb3638f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:46.318979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f0a6d-d60d-4f9c-b67e-65e2eb3638f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:46.319390 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f0a6d-d60d-4f9c-b67e-65e2eb3638f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:46.333566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f0a6d-d60d-4f9c-b67e-65e2eb3638f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:46.338138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f0a6d-d60d-4f9c-b67e-65e2eb3638f8 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:46.350258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 765/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:48.396303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572856cb-cb90-4ec0-a243-5d926d0de27e None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.396853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572856cb-cb90-4ec0-a243-5d926d0de27e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.396853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572856cb-cb90-4ec0-a243-5d926d0de27e None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.398228 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 18:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:06:48.403416 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c3cc-f818-4bc2-bc78-3be7bb0f5e14 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.403818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c3cc-f818-4bc2-bc78-3be7bb0f5e14 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.403966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0c3cc-f818-4bc2-bc78-3be7bb0f5e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.423338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c7a0c3cc-f818-4bc2-bc78-3be7bb0f5e14 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:06:48.424483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c7a0c3cc-f818-4bc2-bc78-3be7bb0f5e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.432422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 18:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:06:48.739559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572856cb-cb90-4ec0-a243-5d926d0de27e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:06:48.741266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-572856cb-cb90-4ec0-a243-5d926d0de27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:06:48.755628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572856cb-cb90-4ec0-a243-5d926d0de27e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:06:48.759277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aec445-9990-4de8-bd91-65ee49d7f64c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:06:48.759882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aec445-9990-4de8-bd91-65ee49d7f64c service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:06:48.763195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aec445-9990-4de8-bd91-65ee49d7f64c service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:06:48.763195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aec445-9990-4de8-bd91-65ee49d7f64c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:06:48.769437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aec445-9990-4de8-bd91-65ee49d7f64c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:06:48.770858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aec445-9990-4de8-bd91-65ee49d7f64c service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:06:48.780220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 773/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:06:58.418306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=11 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:58.776025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=33 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:21.817286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ddad4-1ad8-47ca-a3d0-e9ca24a1de83 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:21.818463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ddad4-1ad8-47ca-a3d0-e9ca24a1de83 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:21.818463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ddad4-1ad8-47ca-a3d0-e9ca24a1de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:21.842670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2e1ddad4-1ad8-47ca-a3d0-e9ca24a1de83 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:21.844260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2e1ddad4-1ad8-47ca-a3d0-e9ca24a1de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:21.855838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 767/1540] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:21.864409 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e01c2-0e58-4ffe-8b1e-7ac128f28ac8 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:21.864987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e01c2-0e58-4ffe-8b1e-7ac128f28ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:21.865072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e01c2-0e58-4ffe-8b1e-7ac128f28ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:21.905831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c86e01c2-0e58-4ffe-8b1e-7ac128f28ac8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:21.907055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c86e01c2-0e58-4ffe-8b1e-7ac128f28ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:21.921866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 774/1541] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:21.929522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ddad4-1ad8-47ca-a3d0-e9ca24a1de83 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:21.940201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ddad4-1ad8-47ca-a3d0-e9ca24a1de83 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:21.953447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095571c-96de-489f-b9ce-7a78efed16d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:21.954399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095571c-96de-489f-b9ce-7a78efed16d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:21.954898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095571c-96de-489f-b9ce-7a78efed16d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:21.955485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095571c-96de-489f-b9ce-7a78efed16d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:21.956407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095571c-96de-489f-b9ce-7a78efed16d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:21.956989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095571c-96de-489f-b9ce-7a78efed16d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:21.958981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095571c-96de-489f-b9ce-7a78efed16d0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:21.972940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 768/1542] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:21.982647 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e01c2-0e58-4ffe-8b1e-7ac128f28ac8 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.000933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e01c2-0e58-4ffe-8b1e-7ac128f28ac8 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.009355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6521e9-e19e-4181-8d55-8b1769b969a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.009991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6521e9-e19e-4181-8d55-8b1769b969a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.010272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6521e9-e19e-4181-8d55-8b1769b969a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.010544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6521e9-e19e-4181-8d55-8b1769b969a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.011217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6521e9-e19e-4181-8d55-8b1769b969a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.013246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6521e9-e19e-4181-8d55-8b1769b969a9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.081011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261acd9d-0f3b-465d-aa17-85919d0edf24 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.081656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261acd9d-0f3b-465d-aa17-85919d0edf24 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.082293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261acd9d-0f3b-465d-aa17-85919d0edf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.117934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-261acd9d-0f3b-465d-aa17-85919d0edf24 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.119782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-261acd9d-0f3b-465d-aa17-85919d0edf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.131157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 769/1543] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:22.140859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce1001-17c2-4d20-a9c8-ddb99b654aca None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.141717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce1001-17c2-4d20-a9c8-ddb99b654aca None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.142219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce1001-17c2-4d20-a9c8-ddb99b654aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.151112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 775/1544] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:21 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:22.158318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9cf45-e6f8-4c2f-bc37-1c6704c58734 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.158318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9cf45-e6f8-4c2f-bc37-1c6704c58734 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.158318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9cf45-e6f8-4c2f-bc37-1c6704c58734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.190067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-01ce1001-17c2-4d20-a9c8-ddb99b654aca None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.191676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-01ce1001-17c2-4d20-a9c8-ddb99b654aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.212920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-95f9cf45-e6f8-4c2f-bc37-1c6704c58734 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.221587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-95f9cf45-e6f8-4c2f-bc37-1c6704c58734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.270189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 770/1545] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:22.271467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce1001-17c2-4d20-a9c8-ddb99b654aca None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.282598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce1001-17c2-4d20-a9c8-ddb99b654aca None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.289121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4db5c-073e-40ee-85b1-289fc08e819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.290013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4db5c-073e-40ee-85b1-289fc08e819f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.290507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4db5c-073e-40ee-85b1-289fc08e819f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.290852 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4db5c-073e-40ee-85b1-289fc08e819f admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.291584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4db5c-073e-40ee-85b1-289fc08e819f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.293527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4db5c-073e-40ee-85b1-289fc08e819f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.301541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 776/1546] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.312446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706dc8a-dfff-4918-83f4-554398360cde None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.312759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706dc8a-dfff-4918-83f4-554398360cde None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.313052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706dc8a-dfff-4918-83f4-554398360cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.339472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9706dc8a-dfff-4918-83f4-554398360cde None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.339472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9706dc8a-dfff-4918-83f4-554398360cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.342453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 777/1547] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.343618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311e131-b4ca-4997-badd-1c39f8aca836 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.343903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311e131-b4ca-4997-badd-1c39f8aca836 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.344180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311e131-b4ca-4997-badd-1c39f8aca836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.363336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2311e131-b4ca-4997-badd-1c39f8aca836 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.364507 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2311e131-b4ca-4997-badd-1c39f8aca836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.372835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 778/1548] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.375597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203ad38-c9cf-445c-83c3-f64c2c86707d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.375881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203ad38-c9cf-445c-83c3-f64c2c86707d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.376155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203ad38-c9cf-445c-83c3-f64c2c86707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.394728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-0203ad38-c9cf-445c-83c3-f64c2c86707d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.395890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0203ad38-c9cf-445c-83c3-f64c2c86707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.403870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 771/1549] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:22.404511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 779/1550] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.419731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203ad38-c9cf-445c-83c3-f64c2c86707d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.419898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f6908-a35b-4ece-9c6d-7705802cf0ae None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.419898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f6908-a35b-4ece-9c6d-7705802cf0ae None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.419898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f6908-a35b-4ece-9c6d-7705802cf0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.420196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203ad38-c9cf-445c-83c3-f64c2c86707d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.422360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283a6b2-6cb8-4bf4-a866-698015d76f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.422901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283a6b2-6cb8-4bf4-a866-698015d76f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.423180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283a6b2-6cb8-4bf4-a866-698015d76f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.423450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283a6b2-6cb8-4bf4-a866-698015d76f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.424175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283a6b2-6cb8-4bf4-a866-698015d76f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:22.424505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283a6b2-6cb8-4bf4-a866-698015d76f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.425590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WARNING py.warnings [None req-d283a6b2-6cb8-4bf4-a866-698015d76f87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:08:22.425590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: warnings.warn(msg) Jul 28 18:08:22.425590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: Jul 28 18:08:22.425942 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-696f6908-a35b-4ece-9c6d-7705802cf0ae None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.426468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283a6b2-6cb8-4bf4-a866-698015d76f87 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.427118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-696f6908-a35b-4ece-9c6d-7705802cf0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.435880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 772/1551] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.437217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd3a54-66ae-4578-9561-ffb1718dcab7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.437553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd3a54-66ae-4578-9561-ffb1718dcab7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.437833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd3a54-66ae-4578-9561-ffb1718dcab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.444825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 780/1552] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:22.446430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752d87b-da9b-4a85-8252-eed0eaf7feef None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.446718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752d87b-da9b-4a85-8252-eed0eaf7feef None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.446990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752d87b-da9b-4a85-8252-eed0eaf7feef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.467123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-e752d87b-da9b-4a85-8252-eed0eaf7feef None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.467559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-39dd3a54-66ae-4578-9561-ffb1718dcab7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.468311 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e752d87b-da9b-4a85-8252-eed0eaf7feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.468724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-39dd3a54-66ae-4578-9561-ffb1718dcab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.476658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 781/1553] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.480819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 773/1554] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.480994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f892493-16eb-443f-a781-5222fe2b3a88 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.480994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f892493-16eb-443f-a781-5222fe2b3a88 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.481187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87e30c-df94-44a3-a83e-8e25cbe179cc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.481280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f892493-16eb-443f-a781-5222fe2b3a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.481359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87e30c-df94-44a3-a83e-8e25cbe179cc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.481359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87e30c-df94-44a3-a83e-8e25cbe179cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.498393 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2d87e30c-df94-44a3-a83e-8e25cbe179cc None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.498575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-3f892493-16eb-443f-a781-5222fe2b3a88 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.499591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2d87e30c-df94-44a3-a83e-8e25cbe179cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.499717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-3f892493-16eb-443f-a781-5222fe2b3a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.507840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 782/1555] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.507981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 774/1556] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.508407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f892493-16eb-443f-a781-5222fe2b3a88 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.510167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4c5a-6ae2-493e-afb6-0e88d2ae9a94 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.510452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4c5a-6ae2-493e-afb6-0e88d2ae9a94 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.510722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4c5a-6ae2-493e-afb6-0e88d2ae9a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.521429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f892493-16eb-443f-a781-5222fe2b3a88 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.526617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78ba07-5505-493e-abe1-ed592d4d899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.527217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78ba07-5505-493e-abe1-ed592d4d899f admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.527499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78ba07-5505-493e-abe1-ed592d4d899f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.527774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78ba07-5505-493e-abe1-ed592d4d899f admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.528464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78ba07-5505-493e-abe1-ed592d4d899f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.529936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-de7b4c5a-6ae2-493e-afb6-0e88d2ae9a94 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.530093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78ba07-5505-493e-abe1-ed592d4d899f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.531100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-de7b4c5a-6ae2-493e-afb6-0e88d2ae9a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.539430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 775/1557] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.540810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f42abe-c766-42c8-a001-2f677305f9c7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.540939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 783/1558] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:22.541041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f42abe-c766-42c8-a001-2f677305f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.541329 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f42abe-c766-42c8-a001-2f677305f9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.541515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78ba07-5505-493e-abe1-ed592d4d899f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.551589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78ba07-5505-493e-abe1-ed592d4d899f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.556749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51265b61-d029-49dc-8d47-4083698aced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.557384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51265b61-d029-49dc-8d47-4083698aced8 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.557664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51265b61-d029-49dc-8d47-4083698aced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.557936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51265b61-d029-49dc-8d47-4083698aced8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.558587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51265b61-d029-49dc-8d47-4083698aced8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.559897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-82f42abe-c766-42c8-a001-2f677305f9c7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.560474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51265b61-d029-49dc-8d47-4083698aced8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.561105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-82f42abe-c766-42c8-a001-2f677305f9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.569641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 776/1559] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.570243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f42abe-c766-42c8-a001-2f677305f9c7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.579238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f42abe-c766-42c8-a001-2f677305f9c7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.583953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95135561-b9d7-4007-9a24-4f618f6eaf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.584629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95135561-b9d7-4007-9a24-4f618f6eaf6c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.592414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95135561-b9d7-4007-9a24-4f618f6eaf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.592414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95135561-b9d7-4007-9a24-4f618f6eaf6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.592414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95135561-b9d7-4007-9a24-4f618f6eaf6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:22.592414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95135561-b9d7-4007-9a24-4f618f6eaf6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.592414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95135561-b9d7-4007-9a24-4f618f6eaf6c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.599918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 777/1560] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:22.601672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8edf-738f-4886-872f-aaf4cd410aa0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.601955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8edf-738f-4886-872f-aaf4cd410aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.602230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8edf-738f-4886-872f-aaf4cd410aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.621570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4c1a8edf-738f-4886-872f-aaf4cd410aa0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:22.626042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4c1a8edf-738f-4886-872f-aaf4cd410aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:22.630924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 778/1561] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:22.632206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a8edf-738f-4886-872f-aaf4cd410aa0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.641249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a8edf-738f-4886-872f-aaf4cd410aa0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.646057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459c1e2-2b93-4dee-8efc-f639cc8e9a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.646625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c1e2-2b93-4dee-8efc-f639cc8e9a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.648968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c1e2-2b93-4dee-8efc-f639cc8e9a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.648968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c1e2-2b93-4dee-8efc-f639cc8e9a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.648968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459c1e2-2b93-4dee-8efc-f639cc8e9a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:22.648968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459c1e2-2b93-4dee-8efc-f639cc8e9a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.650331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459c1e2-2b93-4dee-8efc-f639cc8e9a86 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.661609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 779/1562] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:22.662358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459c1e2-2b93-4dee-8efc-f639cc8e9a86 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.672649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459c1e2-2b93-4dee-8efc-f639cc8e9a86 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.677378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877c9cc-46ee-4d04-955e-741baa8f3b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.684418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c9cc-46ee-4d04-955e-741baa8f3b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.684418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c9cc-46ee-4d04-955e-741baa8f3b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.684418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c9cc-46ee-4d04-955e-741baa8f3b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.684418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877c9cc-46ee-4d04-955e-741baa8f3b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:22.684418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877c9cc-46ee-4d04-955e-741baa8f3b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.684418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877c9cc-46ee-4d04-955e-741baa8f3b51 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.688616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 784/1563] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:22.688616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51265b61-d029-49dc-8d47-4083698aced8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.702501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 780/1564] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:22.702501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877c9cc-46ee-4d04-955e-741baa8f3b51 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.705847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877c9cc-46ee-4d04-955e-741baa8f3b51 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.738765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:22.740587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:22.757417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51265b61-d029-49dc-8d47-4083698aced8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.761856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db7dc9-09bc-4fcd-9f0b-675bd2c57ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.762182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce35bee-d48f-4bfe-b00b-619e4b3191ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.762469 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db7dc9-09bc-4fcd-9f0b-675bd2c57ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.762751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db7dc9-09bc-4fcd-9f0b-675bd2c57ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.762870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce35bee-d48f-4bfe-b00b-619e4b3191ec admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.763028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db7dc9-09bc-4fcd-9f0b-675bd2c57ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.763130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce35bee-d48f-4bfe-b00b-619e4b3191ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.763317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce35bee-d48f-4bfe-b00b-619e4b3191ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.763747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db7dc9-09bc-4fcd-9f0b-675bd2c57ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:22.764004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce35bee-d48f-4bfe-b00b-619e4b3191ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.764108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db7dc9-09bc-4fcd-9f0b-675bd2c57ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.765636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce35bee-d48f-4bfe-b00b-619e4b3191ec admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.765744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db7dc9-09bc-4fcd-9f0b-675bd2c57ddd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.778828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 785/1565] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:22.778828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce35bee-d48f-4bfe-b00b-619e4b3191ec admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.779108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 781/1566] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:22.779108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db7dc9-09bc-4fcd-9f0b-675bd2c57ddd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.785600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce35bee-d48f-4bfe-b00b-619e4b3191ec admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.791065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193dde87-e02e-4861-927a-b5e6d798939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.791689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dde87-e02e-4861-927a-b5e6d798939c admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.791967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dde87-e02e-4861-927a-b5e6d798939c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.792240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193dde87-e02e-4861-927a-b5e6d798939c admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.792984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193dde87-e02e-4861-927a-b5e6d798939c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:22.793290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193dde87-e02e-4861-927a-b5e6d798939c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.794079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db7dc9-09bc-4fcd-9f0b-675bd2c57ddd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.794878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193dde87-e02e-4861-927a-b5e6d798939c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.798783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef652d9e-488c-401d-aed6-088f36f1daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.799892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef652d9e-488c-401d-aed6-088f36f1daaa admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.799892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef652d9e-488c-401d-aed6-088f36f1daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.800092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef652d9e-488c-401d-aed6-088f36f1daaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.800885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef652d9e-488c-401d-aed6-088f36f1daaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.802029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-ef652d9e-488c-401d-aed6-088f36f1daaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:08:22.802029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 28 18:08:22.802029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: Jul 28 18:08:22.802925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef652d9e-488c-401d-aed6-088f36f1daaa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.808662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 786/1567] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:22.809440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193dde87-e02e-4861-927a-b5e6d798939c admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.820334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193dde87-e02e-4861-927a-b5e6d798939c admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.825804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d92c4b-a11d-4c45-9900-a75922b78c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.826407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d92c4b-a11d-4c45-9900-a75922b78c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.826689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d92c4b-a11d-4c45-9900-a75922b78c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.826958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d92c4b-a11d-4c45-9900-a75922b78c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.827641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d92c4b-a11d-4c45-9900-a75922b78c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:22.827941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d92c4b-a11d-4c45-9900-a75922b78c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.829565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d92c4b-a11d-4c45-9900-a75922b78c87 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.841346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 787/1568] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:22.842107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d92c4b-a11d-4c45-9900-a75922b78c87 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:22.855393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d92c4b-a11d-4c45-9900-a75922b78c87 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:22.856420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39559a-b435-4bf5-ad92-fb29ffb40cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:22.857023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39559a-b435-4bf5-ad92-fb29ffb40cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:22.857302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39559a-b435-4bf5-ad92-fb29ffb40cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:22.857575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39559a-b435-4bf5-ad92-fb29ffb40cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:22.858241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39559a-b435-4bf5-ad92-fb29ffb40cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:22.860096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39559a-b435-4bf5-ad92-fb29ffb40cb5 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:22.980921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 782/1569] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/projects => generated 405 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:22.981866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef652d9e-488c-401d-aed6-088f36f1daaa admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.015821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 788/1570] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:23.016626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39559a-b435-4bf5-ad92-fb29ffb40cb5 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.043269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef652d9e-488c-401d-aed6-088f36f1daaa admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.079741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39559a-b435-4bf5-ad92-fb29ffb40cb5 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.084592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a5fbd-a8b3-45cb-b22f-e9b8de72910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.085980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a5fbd-a8b3-45cb-b22f-e9b8de72910b admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.086265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a5fbd-a8b3-45cb-b22f-e9b8de72910b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.086536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a5fbd-a8b3-45cb-b22f-e9b8de72910b admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.087195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a5fbd-a8b3-45cb-b22f-e9b8de72910b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.089210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a5fbd-a8b3-45cb-b22f-e9b8de72910b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.103273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74548add-e2a1-4c6b-a421-14dacb00c553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.103889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548add-e2a1-4c6b-a421-14dacb00c553 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.104160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548add-e2a1-4c6b-a421-14dacb00c553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.104426 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548add-e2a1-4c6b-a421-14dacb00c553 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.105116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74548add-e2a1-4c6b-a421-14dacb00c553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.107098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74548add-e2a1-4c6b-a421-14dacb00c553 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.177232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 789/1571] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:23.178192 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a5fbd-a8b3-45cb-b22f-e9b8de72910b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.197593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 783/1572] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:22 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:23.198769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74548add-e2a1-4c6b-a421-14dacb00c553 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.208692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74548add-e2a1-4c6b-a421-14dacb00c553 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.245508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a5fbd-a8b3-45cb-b22f-e9b8de72910b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.250976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f615b-da04-49e9-8507-7397414cd2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.251945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f615b-da04-49e9-8507-7397414cd2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.252229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f615b-da04-49e9-8507-7397414cd2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.252499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f615b-da04-49e9-8507-7397414cd2dd admin admin] PATH_INFO: `/v3/projects/816fb0e7557d4fd6b550f81514a13e67/users/447e163734594f7a8bce9504984b02e1/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.254059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:23.266842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d6f81-254e-40b9-bd10-f045fa6c792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.273200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d6f81-254e-40b9-bd10-f045fa6c792d admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.273200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d6f81-254e-40b9-bd10-f045fa6c792d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.273200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d6f81-254e-40b9-bd10-f045fa6c792d admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.273200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d6f81-254e-40b9-bd10-f045fa6c792d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.273200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d6f81-254e-40b9-bd10-f045fa6c792d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.274556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f615b-da04-49e9-8507-7397414cd2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=816fb0e7557d4fd6b550f81514a13e67, user_id=447e163734594f7a8bce9504984b02e1, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.277267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f615b-da04-49e9-8507-7397414cd2dd admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.392702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:23.397960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 790/1573] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:23 2022] PUT /identity/v3/projects/816fb0e7557d4fd6b550f81514a13e67/users/447e163734594f7a8bce9504984b02e1/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:23.398786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f615b-da04-49e9-8507-7397414cd2dd admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.415796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 784/1574] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:23.416612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d6f81-254e-40b9-bd10-f045fa6c792d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.465443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f615b-da04-49e9-8507-7397414cd2dd admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.478698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d6f81-254e-40b9-bd10-f045fa6c792d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.483467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732e534-ffa3-4b3e-8027-1e633be86f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.484113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732e534-ffa3-4b3e-8027-1e633be86f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.484489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732e534-ffa3-4b3e-8027-1e633be86f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.484768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732e534-ffa3-4b3e-8027-1e633be86f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.485501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732e534-ffa3-4b3e-8027-1e633be86f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.487412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732e534-ffa3-4b3e-8027-1e633be86f58 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.521243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b737e-b751-41e5-a7df-8d220bf12e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.521858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b737e-b751-41e5-a7df-8d220bf12e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.522140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b737e-b751-41e5-a7df-8d220bf12e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.522973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b737e-b751-41e5-a7df-8d220bf12e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.523637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b737e-b751-41e5-a7df-8d220bf12e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.525570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b737e-b751-41e5-a7df-8d220bf12e96 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.612968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 785/1575] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:23.612968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732e534-ffa3-4b3e-8027-1e633be86f58 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.659268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 791/1576] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:23.659268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b737e-b751-41e5-a7df-8d220bf12e96 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.678708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732e534-ffa3-4b3e-8027-1e633be86f58 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.717369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b737e-b751-41e5-a7df-8d220bf12e96 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.722167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22331f-d9c8-4d5d-a1b6-a8b64049ebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.722799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22331f-d9c8-4d5d-a1b6-a8b64049ebc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.723062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22331f-d9c8-4d5d-a1b6-a8b64049ebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.723337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22331f-d9c8-4d5d-a1b6-a8b64049ebc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.723999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22331f-d9c8-4d5d-a1b6-a8b64049ebc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.725052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WARNING py.warnings [None req-ad22331f-d9c8-4d5d-a1b6-a8b64049ebc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:08:23.725052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: warnings.warn(msg) Jul 28 18:08:23.725052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: Jul 28 18:08:23.726295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22331f-d9c8-4d5d-a1b6-a8b64049ebc3 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.735991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62885588-a294-4322-99a4-f98fde2fe957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.736640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62885588-a294-4322-99a4-f98fde2fe957 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.736954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62885588-a294-4322-99a4-f98fde2fe957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.737226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62885588-a294-4322-99a4-f98fde2fe957 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.737885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62885588-a294-4322-99a4-f98fde2fe957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.739814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62885588-a294-4322-99a4-f98fde2fe957 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.749891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:23.859755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 792/1577] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:23.860625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22331f-d9c8-4d5d-a1b6-a8b64049ebc3 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.870986 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22331f-d9c8-4d5d-a1b6-a8b64049ebc3 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.872897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 786/1578] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/users => generated 303 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:23.873919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62885588-a294-4322-99a4-f98fde2fe957 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.875703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13322644-413f-4e9b-847b-35d69beccedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.876327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13322644-413f-4e9b-847b-35d69beccedd admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.876589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13322644-413f-4e9b-847b-35d69beccedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.876891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13322644-413f-4e9b-847b-35d69beccedd admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.877555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13322644-413f-4e9b-847b-35d69beccedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.879517 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13322644-413f-4e9b-847b-35d69beccedd admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.885797 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62885588-a294-4322-99a4-f98fde2fe957 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.891179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a343d-63f0-4a3f-892d-ed1ac6b754e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.891787 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a343d-63f0-4a3f-892d-ed1ac6b754e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.892070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a343d-63f0-4a3f-892d-ed1ac6b754e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.892347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a343d-63f0-4a3f-892d-ed1ac6b754e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.895070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a343d-63f0-4a3f-892d-ed1ac6b754e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.896680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a343d-63f0-4a3f-892d-ed1ac6b754e9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.909158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 787/1579] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:23.918008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f72ac-aede-4c47-bba9-47c2a7eb548f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.918008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f72ac-aede-4c47-bba9-47c2a7eb548f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.918008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f72ac-aede-4c47-bba9-47c2a7eb548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.931667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dc5f72ac-aede-4c47-bba9-47c2a7eb548f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:23.932907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dc5f72ac-aede-4c47-bba9-47c2a7eb548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:23.940398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 788/1580] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:23.941298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f72ac-aede-4c47-bba9-47c2a7eb548f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:23.951552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f72ac-aede-4c47-bba9-47c2a7eb548f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:23.962419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903173c0-7fdc-4e3c-88d1-939f0f8b92ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:23.962419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903173c0-7fdc-4e3c-88d1-939f0f8b92ab admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:23.962419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903173c0-7fdc-4e3c-88d1-939f0f8b92ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:23.962419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903173c0-7fdc-4e3c-88d1-939f0f8b92ab admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:23.962854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903173c0-7fdc-4e3c-88d1-939f0f8b92ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:23.962854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903173c0-7fdc-4e3c-88d1-939f0f8b92ab admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:23.997638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 793/1581] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:23.998587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13322644-413f-4e9b-847b-35d69beccedd admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.004468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:24.008920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13322644-413f-4e9b-847b-35d69beccedd admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.013577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b28d7-9127-4580-9069-b7267563114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.014167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b28d7-9127-4580-9069-b7267563114e admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.014450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b28d7-9127-4580-9069-b7267563114e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.014747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b28d7-9127-4580-9069-b7267563114e admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.015401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b28d7-9127-4580-9069-b7267563114e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.017346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b28d7-9127-4580-9069-b7267563114e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.100050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 789/1582] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:24.101386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903173c0-7fdc-4e3c-88d1-939f0f8b92ab admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.110764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903173c0-7fdc-4e3c-88d1-939f0f8b92ab admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.115396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086e767-0ad8-4407-9c88-ab58110aa125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.115973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e767-0ad8-4407-9c88-ab58110aa125 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.116827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e767-0ad8-4407-9c88-ab58110aa125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.117108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086e767-0ad8-4407-9c88-ab58110aa125 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.117755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086e767-0ad8-4407-9c88-ab58110aa125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.119732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086e767-0ad8-4407-9c88-ab58110aa125 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.135624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 794/1583] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:23 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:24.136671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b28d7-9127-4580-9069-b7267563114e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.146331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b28d7-9127-4580-9069-b7267563114e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.150976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13657516-c57e-4101-9d9c-0b44d2385275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.151553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13657516-c57e-4101-9d9c-0b44d2385275 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.151834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13657516-c57e-4101-9d9c-0b44d2385275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.152110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13657516-c57e-4101-9d9c-0b44d2385275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.152808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13657516-c57e-4101-9d9c-0b44d2385275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.154414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13657516-c57e-4101-9d9c-0b44d2385275 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.168085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 795/1584] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.168085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13657516-c57e-4101-9d9c-0b44d2385275 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.186242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13657516-c57e-4101-9d9c-0b44d2385275 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.186242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8105a40-a59c-455e-bea1-4b52d673668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.186242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8105a40-a59c-455e-bea1-4b52d673668d admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.186242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8105a40-a59c-455e-bea1-4b52d673668d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.186659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8105a40-a59c-455e-bea1-4b52d673668d admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.186659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8105a40-a59c-455e-bea1-4b52d673668d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.186659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8105a40-a59c-455e-bea1-4b52d673668d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.201284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 796/1585] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.202264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8105a40-a59c-455e-bea1-4b52d673668d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.214513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8105a40-a59c-455e-bea1-4b52d673668d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.221204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1571a-1fed-4a71-ad73-01477de774ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.222083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1571a-1fed-4a71-ad73-01477de774ac admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.222506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1571a-1fed-4a71-ad73-01477de774ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.222925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1571a-1fed-4a71-ad73-01477de774ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.223991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1571a-1fed-4a71-ad73-01477de774ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.227113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1571a-1fed-4a71-ad73-01477de774ac admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.243332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 797/1586] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.244587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1571a-1fed-4a71-ad73-01477de774ac admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.246717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cfd1571a-1fed-4a71-ad73-01477de774ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:24.254243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 790/1587] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:24 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:24.255136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086e767-0ad8-4407-9c88-ab58110aa125 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.264905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086e767-0ad8-4407-9c88-ab58110aa125 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.269714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d364275-977e-4a42-8d85-9876f9cd6ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.279418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d364275-977e-4a42-8d85-9876f9cd6ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.279418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d364275-977e-4a42-8d85-9876f9cd6ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.279418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d364275-977e-4a42-8d85-9876f9cd6ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.279418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d364275-977e-4a42-8d85-9876f9cd6ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.279418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d364275-977e-4a42-8d85-9876f9cd6ebd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.284421 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 791/1588] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.285251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d364275-977e-4a42-8d85-9876f9cd6ebd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.297868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d364275-977e-4a42-8d85-9876f9cd6ebd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.302839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea7e62-5f0d-4da3-9d78-73a75dfb4deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.303656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea7e62-5f0d-4da3-9d78-73a75dfb4deb admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.304394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea7e62-5f0d-4da3-9d78-73a75dfb4deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.304663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea7e62-5f0d-4da3-9d78-73a75dfb4deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.305374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea7e62-5f0d-4da3-9d78-73a75dfb4deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.310292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea7e62-5f0d-4da3-9d78-73a75dfb4deb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.313073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1571a-1fed-4a71-ad73-01477de774ac admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.317029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff92a15-a477-4892-b9f9-1624344d004a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.317642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff92a15-a477-4892-b9f9-1624344d004a service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.320766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 792/1589] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.320935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff92a15-a477-4892-b9f9-1624344d004a service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.320935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff92a15-a477-4892-b9f9-1624344d004a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.321120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea7e62-5f0d-4da3-9d78-73a75dfb4deb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.328453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff92a15-a477-4892-b9f9-1624344d004a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.329952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff92a15-a477-4892-b9f9-1624344d004a service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.330381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea7e62-5f0d-4da3-9d78-73a75dfb4deb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.335041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84147473-d780-4efc-9e7a-b7bdf2defac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.335885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147473-d780-4efc-9e7a-b7bdf2defac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.336163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147473-d780-4efc-9e7a-b7bdf2defac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.336913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147473-d780-4efc-9e7a-b7bdf2defac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.337599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84147473-d780-4efc-9e7a-b7bdf2defac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.339159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84147473-d780-4efc-9e7a-b7bdf2defac4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.340136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 798/1590] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:24.341102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff92a15-a477-4892-b9f9-1624344d004a service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.350166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff92a15-a477-4892-b9f9-1624344d004a service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.350821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 793/1591] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.351666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84147473-d780-4efc-9e7a-b7bdf2defac4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.357853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf6754-303c-4036-9744-ff2da1d98aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.358683 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf6754-303c-4036-9744-ff2da1d98aac admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.358948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf6754-303c-4036-9744-ff2da1d98aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.359217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf6754-303c-4036-9744-ff2da1d98aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.359912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf6754-303c-4036-9744-ff2da1d98aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.361610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf6754-303c-4036-9744-ff2da1d98aac admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.362460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84147473-d780-4efc-9e7a-b7bdf2defac4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.368562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf5592-f61c-4e1f-adef-5815a36557cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.369223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf5592-f61c-4e1f-adef-5815a36557cc admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.369665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf5592-f61c-4e1f-adef-5815a36557cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.370101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf5592-f61c-4e1f-adef-5815a36557cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.370925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf5592-f61c-4e1f-adef-5815a36557cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.375588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 799/1592] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.375724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf5592-f61c-4e1f-adef-5815a36557cc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.375832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf6754-303c-4036-9744-ff2da1d98aac admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.382589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf6754-303c-4036-9744-ff2da1d98aac admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.386927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 794/1593] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.386927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf5592-f61c-4e1f-adef-5815a36557cc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.389804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733c0a-3b85-4fed-9941-262fbd52efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.390447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733c0a-3b85-4fed-9941-262fbd52efac admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.390728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733c0a-3b85-4fed-9941-262fbd52efac admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.391001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733c0a-3b85-4fed-9941-262fbd52efac admin admin] PATH_INFO: `/v3/projects/d1bb557089e14bfb989875b52bd6433a/users/a9a9b044d2c54c3b8e6350f1f7443d3f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.396570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf5592-f61c-4e1f-adef-5815a36557cc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.401644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30835-5e43-4835-82db-287a64269112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.402620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30835-5e43-4835-82db-287a64269112 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.402905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30835-5e43-4835-82db-287a64269112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.403180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30835-5e43-4835-82db-287a64269112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.403865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30835-5e43-4835-82db-287a64269112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.405511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30835-5e43-4835-82db-287a64269112 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.405728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5733c0a-3b85-4fed-9941-262fbd52efac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bb557089e14bfb989875b52bd6433a, user_id=a9a9b044d2c54c3b8e6350f1f7443d3f, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.408362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5733c0a-3b85-4fed-9941-262fbd52efac admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.416040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 795/1594] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.416846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30835-5e43-4835-82db-287a64269112 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.426049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30835-5e43-4835-82db-287a64269112 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.431069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c54b13-cc12-40aa-815e-2a9a8ef41fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.431635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c54b13-cc12-40aa-815e-2a9a8ef41fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.431958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c54b13-cc12-40aa-815e-2a9a8ef41fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.432232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c54b13-cc12-40aa-815e-2a9a8ef41fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.432928 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c54b13-cc12-40aa-815e-2a9a8ef41fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.434474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c54b13-cc12-40aa-815e-2a9a8ef41fcc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.444492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 796/1595] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.445511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c54b13-cc12-40aa-815e-2a9a8ef41fcc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.454869 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c54b13-cc12-40aa-815e-2a9a8ef41fcc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.459411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894dc9a-a670-4cd2-87c3-04dee806dd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.460034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894dc9a-a670-4cd2-87c3-04dee806dd29 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.460561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894dc9a-a670-4cd2-87c3-04dee806dd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.460880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894dc9a-a670-4cd2-87c3-04dee806dd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.461556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894dc9a-a670-4cd2-87c3-04dee806dd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.463141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894dc9a-a670-4cd2-87c3-04dee806dd29 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.473477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 797/1596] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.474277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894dc9a-a670-4cd2-87c3-04dee806dd29 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.484648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894dc9a-a670-4cd2-87c3-04dee806dd29 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.489939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7b82-e3fa-4aa3-b17b-e9da27701a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.490535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7b82-e3fa-4aa3-b17b-e9da27701a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.490820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7b82-e3fa-4aa3-b17b-e9da27701a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.491192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f7b82-e3fa-4aa3-b17b-e9da27701a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.491891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f7b82-e3fa-4aa3-b17b-e9da27701a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.493587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f7b82-e3fa-4aa3-b17b-e9da27701a8e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.503614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 798/1597] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.504385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7b82-e3fa-4aa3-b17b-e9da27701a8e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.514161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f7b82-e3fa-4aa3-b17b-e9da27701a8e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.520404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ff4fb-6fbc-4446-b248-1e2af73f9496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.521085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ff4fb-6fbc-4446-b248-1e2af73f9496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.526083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ff4fb-6fbc-4446-b248-1e2af73f9496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.526083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ff4fb-6fbc-4446-b248-1e2af73f9496 admin admin] PATH_INFO: `/v3/projects/fc34827d713e4d7ba12a1b93cf0878ca/users/e01fd82a1ff44587b45f72f82e1562a4/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.526386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 800/1598] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:24 2022] PUT /identity/v3/projects/d1bb557089e14bfb989875b52bd6433a/users/a9a9b044d2c54c3b8e6350f1f7443d3f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:24.526386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733c0a-3b85-4fed-9941-262fbd52efac admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.537162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ff4fb-6fbc-4446-b248-1e2af73f9496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc34827d713e4d7ba12a1b93cf0878ca, user_id=e01fd82a1ff44587b45f72f82e1562a4, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.538758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-da2ff4fb-6fbc-4446-b248-1e2af73f9496 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:08:24.538758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 28 18:08:24.538758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: Jul 28 18:08:24.540685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ff4fb-6fbc-4446-b248-1e2af73f9496 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.592320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733c0a-3b85-4fed-9941-262fbd52efac admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.597043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa426991-7f30-4d75-983f-3dd11f259586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.597713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa426991-7f30-4d75-983f-3dd11f259586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.597991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa426991-7f30-4d75-983f-3dd11f259586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.598265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa426991-7f30-4d75-983f-3dd11f259586 admin admin] PATH_INFO: `/v3/projects/1b1a62abbf574258bee7fcbd108da1e0/users/efe43f98c4404fe6a28bb2c0efd28b61/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.612860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa426991-7f30-4d75-983f-3dd11f259586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1a62abbf574258bee7fcbd108da1e0, user_id=efe43f98c4404fe6a28bb2c0efd28b61, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.615609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa426991-7f30-4d75-983f-3dd11f259586 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.671157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 799/1599] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:24 2022] PUT /identity/v3/projects/fc34827d713e4d7ba12a1b93cf0878ca/users/e01fd82a1ff44587b45f72f82e1562a4/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:24.671157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ff4fb-6fbc-4446-b248-1e2af73f9496 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.715044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:24.728636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ff4fb-6fbc-4446-b248-1e2af73f9496 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.735193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 801/1600] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:24 2022] PUT /identity/v3/projects/1b1a62abbf574258bee7fcbd108da1e0/users/efe43f98c4404fe6a28bb2c0efd28b61/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:24.736156 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa426991-7f30-4d75-983f-3dd11f259586 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.741937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:24.785967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125da893-152a-409e-978b-8fd8ca585fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.786615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125da893-152a-409e-978b-8fd8ca585fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.786927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125da893-152a-409e-978b-8fd8ca585fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.787199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125da893-152a-409e-978b-8fd8ca585fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.788443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125da893-152a-409e-978b-8fd8ca585fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.790227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125da893-152a-409e-978b-8fd8ca585fd1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.797724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa426991-7f30-4d75-983f-3dd11f259586 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.806570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 800/1601] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:24.806570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125da893-152a-409e-978b-8fd8ca585fd1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:24.806990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fec7f-92eb-41bd-882f-224ffb50b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.806990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fec7f-92eb-41bd-882f-224ffb50b1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.806990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fec7f-92eb-41bd-882f-224ffb50b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.806990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fec7f-92eb-41bd-882f-224ffb50b1a9 admin admin] PATH_INFO: `/v3/projects/5ce6da9de67248e691831a5a2bb6679a/users/9b585090272c4b4ab7d1937ebc9fa649/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.813223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125da893-152a-409e-978b-8fd8ca585fd1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:24.817834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a041bb-678d-40d8-92b8-86dca0a3c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:24.818487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a041bb-678d-40d8-92b8-86dca0a3c936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:24.818766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a041bb-678d-40d8-92b8-86dca0a3c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:24.819061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a041bb-678d-40d8-92b8-86dca0a3c936 admin admin] PATH_INFO: `/v3/projects/23e92273786a4521b8cefefd5b466f14/users/2d7b5ebb4e7a493ab8e3136783c3bcb3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:24.821856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fec7f-92eb-41bd-882f-224ffb50b1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce6da9de67248e691831a5a2bb6679a, user_id=9b585090272c4b4ab7d1937ebc9fa649, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.824556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fec7f-92eb-41bd-882f-224ffb50b1a9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.839714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a041bb-678d-40d8-92b8-86dca0a3c936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e92273786a4521b8cefefd5b466f14, user_id=2d7b5ebb4e7a493ab8e3136783c3bcb3, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:24.842534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a041bb-678d-40d8-92b8-86dca0a3c936 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:24.948464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 802/1602] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:24 2022] PUT /identity/v3/projects/5ce6da9de67248e691831a5a2bb6679a/users/9b585090272c4b4ab7d1937ebc9fa649/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:24.948464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fec7f-92eb-41bd-882f-224ffb50b1a9 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:25.005917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 801/1603] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:24 2022] PUT /identity/v3/projects/23e92273786a4521b8cefefd5b466f14/users/2d7b5ebb4e7a493ab8e3136783c3bcb3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:25.007855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225f39d-e953-4e05-a760-c25345060935 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.008195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225f39d-e953-4e05-a760-c25345060935 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.008547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225f39d-e953-4e05-a760-c25345060935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.017370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fec7f-92eb-41bd-882f-224ffb50b1a9 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:25.044165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c225f39d-e953-4e05-a760-c25345060935 None None] MFA Rules not processed for user `a9a9b044d2c54c3b8e6350f1f7443d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:25.049051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c225f39d-e953-4e05-a760-c25345060935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:25.079100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a46b23-6895-44b1-aa7d-3bfa72298336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:25.079790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46b23-6895-44b1-aa7d-3bfa72298336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.080096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46b23-6895-44b1-aa7d-3bfa72298336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.080373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a46b23-6895-44b1-aa7d-3bfa72298336 admin admin] PATH_INFO: `/v3/projects/dae3bde91381450fbd425643111d2aaf/users/500806c13342413983cb8e2c41dc0ef6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.095178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a46b23-6895-44b1-aa7d-3bfa72298336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae3bde91381450fbd425643111d2aaf, user_id=500806c13342413983cb8e2c41dc0ef6, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:25.098012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a46b23-6895-44b1-aa7d-3bfa72298336 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:25.111377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 802/1604] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:25.112800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e04397-ba17-45dd-8c62-ff543c16471e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.113089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e04397-ba17-45dd-8c62-ff543c16471e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.113362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e04397-ba17-45dd-8c62-ff543c16471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.132992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-91e04397-ba17-45dd-8c62-ff543c16471e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:25.134181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-91e04397-ba17-45dd-8c62-ff543c16471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:25.141906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 803/1605] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:25.143103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896260ef-b558-47f5-91ec-907d2ed2edfb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.143388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896260ef-b558-47f5-91ec-907d2ed2edfb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.143663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896260ef-b558-47f5-91ec-907d2ed2edfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.162422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-896260ef-b558-47f5-91ec-907d2ed2edfb None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:25.164273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-896260ef-b558-47f5-91ec-907d2ed2edfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:25.173012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 804/1606] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:25.176892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896260ef-b558-47f5-91ec-907d2ed2edfb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:25.188438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896260ef-b558-47f5-91ec-907d2ed2edfb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:25.200272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 803/1607] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:24 2022] PUT /identity/v3/projects/dae3bde91381450fbd425643111d2aaf/users/500806c13342413983cb8e2c41dc0ef6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:25.200272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de5c4-bd63-4ec1-a00d-033230fc976c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.200272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de5c4-bd63-4ec1-a00d-033230fc976c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.200272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de5c4-bd63-4ec1-a00d-033230fc976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.218250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-d62de5c4-bd63-4ec1-a00d-033230fc976c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:25.219618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d62de5c4-bd63-4ec1-a00d-033230fc976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:25.232867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:25.249948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:25.268160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07978b8d-eb5b-4239-aae7-8f5f0cca1bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:25.268880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07978b8d-eb5b-4239-aae7-8f5f0cca1bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.269232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07978b8d-eb5b-4239-aae7-8f5f0cca1bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.269599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07978b8d-eb5b-4239-aae7-8f5f0cca1bd6 admin admin] PATH_INFO: `/v3/projects/823933265a4542288e573bdc30ec712e/users/7388d3603bbd428cabf62a1f46e73929/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.285848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07978b8d-eb5b-4239-aae7-8f5f0cca1bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823933265a4542288e573bdc30ec712e, user_id=7388d3603bbd428cabf62a1f46e73929, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:25.287664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 804/1608] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:25.289760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07978b8d-eb5b-4239-aae7-8f5f0cca1bd6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:25.292705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90fea5-4bc9-4c16-90c7-daa1081cecdd None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.293081 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90fea5-4bc9-4c16-90c7-daa1081cecdd None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.293428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90fea5-4bc9-4c16-90c7-daa1081cecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.324869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-fc90fea5-4bc9-4c16-90c7-daa1081cecdd None None] MFA Rules not processed for user `2d7b5ebb4e7a493ab8e3136783c3bcb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:25.326140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fc90fea5-4bc9-4c16-90c7-daa1081cecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:25.385874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 805/1609] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:25 2022] PUT /identity/v3/projects/823933265a4542288e573bdc30ec712e/users/7388d3603bbd428cabf62a1f46e73929/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:25.387023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07978b8d-eb5b-4239-aae7-8f5f0cca1bd6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:25.390793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 805/1610] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:25.391765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90fea5-4bc9-4c16-90c7-daa1081cecdd None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:25.448490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07978b8d-eb5b-4239-aae7-8f5f0cca1bd6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:25.452772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee91c0-1b06-42c4-8f7e-96e1120a24c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:25.453098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee91c0-1b06-42c4-8f7e-96e1120a24c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.453490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee91c0-1b06-42c4-8f7e-96e1120a24c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.453859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee91c0-1b06-42c4-8f7e-96e1120a24c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.458432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90fea5-4bc9-4c16-90c7-daa1081cecdd None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:25.525334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4fd51-b30e-4ead-ab0b-1d6e1f6728e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:25.526117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4fd51-b30e-4ead-ab0b-1d6e1f6728e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.526410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4fd51-b30e-4ead-ab0b-1d6e1f6728e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.526812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4fd51-b30e-4ead-ab0b-1d6e1f6728e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.531109 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee91c0-1b06-42c4-8f7e-96e1120a24c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:25.532538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee91c0-1b06-42c4-8f7e-96e1120a24c7 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:25.542722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 806/1611] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:25.543595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee91c0-1b06-42c4-8f7e-96e1120a24c7 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:25.552264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee91c0-1b06-42c4-8f7e-96e1120a24c7 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:25.556162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fff9c-8c36-4d57-a117-68fca4adf6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:25.556814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fff9c-8c36-4d57-a117-68fca4adf6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.557111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fff9c-8c36-4d57-a117-68fca4adf6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.557388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fff9c-8c36-4d57-a117-68fca4adf6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.558222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:25.597254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4fd51-b30e-4ead-ab0b-1d6e1f6728e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:25.598705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4fd51-b30e-4ead-ab0b-1d6e1f6728e6 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:25.610529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 806/1612] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:25.611860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d42c48-9390-44e6-bf11-4514cf2cb9a9 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.612149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d42c48-9390-44e6-bf11-4514cf2cb9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.612414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d42c48-9390-44e6-bf11-4514cf2cb9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.640399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fff9c-8c36-4d57-a117-68fca4adf6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:25.642087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fff9c-8c36-4d57-a117-68fca4adf6a0 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:25.654616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 807/1613] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:25.658245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fff9c-8c36-4d57-a117-68fca4adf6a0 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:25.658832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-59d42c48-9390-44e6-bf11-4514cf2cb9a9 None None] MFA Rules not processed for user `500806c13342413983cb8e2c41dc0ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:25.660029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-59d42c48-9390-44e6-bf11-4514cf2cb9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:25.676488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fff9c-8c36-4d57-a117-68fca4adf6a0 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:25.681381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8243c8-c235-4f27-8096-64a2f4dc8507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:25.681825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8243c8-c235-4f27-8096-64a2f4dc8507 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.682101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8243c8-c235-4f27-8096-64a2f4dc8507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.682520 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8243c8-c235-4f27-8096-64a2f4dc8507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.693010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8243c8-c235-4f27-8096-64a2f4dc8507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:25.694631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8243c8-c235-4f27-8096-64a2f4dc8507 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:25.705442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 808/1614] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:25.712139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849be930-0262-40b9-8522-42f61f6e5e04 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.712429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849be930-0262-40b9-8522-42f61f6e5e04 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.712713 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849be930-0262-40b9-8522-42f61f6e5e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.756388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-849be930-0262-40b9-8522-42f61f6e5e04 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:25.757825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-849be930-0262-40b9-8522-42f61f6e5e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:25.775860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 807/1615] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:25.777416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680cd25-cdf7-470b-b840-069c2e4ede01 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.777767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680cd25-cdf7-470b-b840-069c2e4ede01 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.778175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680cd25-cdf7-470b-b840-069c2e4ede01 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.779966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 808/1616] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 28 18:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:08:25.780728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680cd25-cdf7-470b-b840-069c2e4ede01 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:25.787590 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 809/1617] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:25.793000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d75e95-8648-46f1-bd07-5ca380f376cd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.793295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d75e95-8648-46f1-bd07-5ca380f376cd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.793576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d75e95-8648-46f1-bd07-5ca380f376cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.796069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680cd25-cdf7-470b-b840-069c2e4ede01 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:25.802872 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4c225-7ff1-486c-a44c-76f08f35cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:25.803753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4c225-7ff1-486c-a44c-76f08f35cb5c admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:25.806937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4c225-7ff1-486c-a44c-76f08f35cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:25.806937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4c225-7ff1-486c-a44c-76f08f35cb5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:25.806937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4c225-7ff1-486c-a44c-76f08f35cb5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:25.810035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4c225-7ff1-486c-a44c-76f08f35cb5c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:25.880386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f3d75e95-8648-46f1-bd07-5ca380f376cd None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:25.882598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f3d75e95-8648-46f1-bd07-5ca380f376cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:25.979620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 810/1618] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 28 18:08:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:25.986385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d75e95-8648-46f1-bd07-5ca380f376cd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:26.001367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d75e95-8648-46f1-bd07-5ca380f376cd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:26.006718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 809/1619] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:25 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:26.008631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4c225-7ff1-486c-a44c-76f08f35cb5c admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:26.013716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12478b-691a-4f36-8e3f-d2e5ba3f3ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:26.014881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12478b-691a-4f36-8e3f-d2e5ba3f3ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.014881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12478b-691a-4f36-8e3f-d2e5ba3f3ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.015214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12478b-691a-4f36-8e3f-d2e5ba3f3ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.051410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12478b-691a-4f36-8e3f-d2e5ba3f3ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:26.054185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12478b-691a-4f36-8e3f-d2e5ba3f3ad7 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:26.080235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 811/1620] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:26.080957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12478b-691a-4f36-8e3f-d2e5ba3f3ad7 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:26.094638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:26.106581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4c225-7ff1-486c-a44c-76f08f35cb5c admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:26.107099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12478b-691a-4f36-8e3f-d2e5ba3f3ad7 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:26.111519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1665-b375-4f2c-8c5e-6bbd3c301c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:26.112203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1665-b375-4f2c-8c5e-6bbd3c301c99 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.112598 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1665-b375-4f2c-8c5e-6bbd3c301c99 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.112919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1665-b375-4f2c-8c5e-6bbd3c301c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.173292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:26.226848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1665-b375-4f2c-8c5e-6bbd3c301c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:26.228483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1665-b375-4f2c-8c5e-6bbd3c301c99 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:26.245242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1350c86-ebb5-4587-8210-9bd26a562dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:26.245964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1350c86-ebb5-4587-8210-9bd26a562dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.246694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1350c86-ebb5-4587-8210-9bd26a562dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.246694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1350c86-ebb5-4587-8210-9bd26a562dcb admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.247246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1350c86-ebb5-4587-8210-9bd26a562dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:26.248685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 810/1621] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:26.252057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1350c86-ebb5-4587-8210-9bd26a562dcb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:26.471910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1665-b375-4f2c-8c5e-6bbd3c301c99 service nova] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:26.473198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 812/1622] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:26 2022] POST /identity/v3/users => generated 300 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:26.488905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1665-b375-4f2c-8c5e-6bbd3c301c99 service nova] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:26.502920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1792c-46c9-4b17-bdd3-4e48395d9112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:26.503296 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1792c-46c9-4b17-bdd3-4e48395d9112 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.503574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1792c-46c9-4b17-bdd3-4e48395d9112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.503842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1792c-46c9-4b17-bdd3-4e48395d9112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.504545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1792c-46c9-4b17-bdd3-4e48395d9112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:26.506344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1792c-46c9-4b17-bdd3-4e48395d9112 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:26.529924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 811/1623] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:08:26.536656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1350c86-ebb5-4587-8210-9bd26a562dcb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:26.552218 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1350c86-ebb5-4587-8210-9bd26a562dcb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:26.560638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acd8f8-24ab-4d31-b8ee-a6ba1d573dbf None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.560963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acd8f8-24ab-4d31-b8ee-a6ba1d573dbf None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.561235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acd8f8-24ab-4d31-b8ee-a6ba1d573dbf None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.562760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 812/1624] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 28 18:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 18:08:26.571357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c89a-f81a-43ce-8919-c07dd236da65 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.571552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f682b-29e8-4984-b2b5-7e4a3bb71a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:26.571688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c89a-f81a-43ce-8919-c07dd236da65 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.571688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c89a-f81a-43ce-8919-c07dd236da65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.571881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f682b-29e8-4984-b2b5-7e4a3bb71a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.571881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f682b-29e8-4984-b2b5-7e4a3bb71a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.571881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f682b-29e8-4984-b2b5-7e4a3bb71a0e admin admin] PATH_INFO: `/v3/projects/6f0172df02a44b9b9bb257de6925f7ee/users/f4c1b11994874bb3855ee16145eb2773/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.591145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-cb90c89a-f81a-43ce-8919-c07dd236da65 None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:26.592712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cb90c89a-f81a-43ce-8919-c07dd236da65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:26.608995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 813/1625] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:08:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:26.611584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f682b-29e8-4984-b2b5-7e4a3bb71a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0172df02a44b9b9bb257de6925f7ee, user_id=f4c1b11994874bb3855ee16145eb2773, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:26.616526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f682b-29e8-4984-b2b5-7e4a3bb71a0e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:26.622464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90c89a-f81a-43ce-8919-c07dd236da65 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:26.699013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90c89a-f81a-43ce-8919-c07dd236da65 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:26.703623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93c47d-04fb-41f2-83b8-b1f4386902c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:26.710176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93c47d-04fb-41f2-83b8-b1f4386902c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.710176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93c47d-04fb-41f2-83b8-b1f4386902c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.710176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93c47d-04fb-41f2-83b8-b1f4386902c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.729205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93c47d-04fb-41f2-83b8-b1f4386902c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:26.731251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93c47d-04fb-41f2-83b8-b1f4386902c2 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:26.747549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 814/1626] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:08:26.755480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 813/1627] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:26 2022] PUT /identity/v3/projects/6f0172df02a44b9b9bb257de6925f7ee/users/f4c1b11994874bb3855ee16145eb2773/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:26.759200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93c47d-04fb-41f2-83b8-b1f4386902c2 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:26.779823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93c47d-04fb-41f2-83b8-b1f4386902c2 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:26.887426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf1ba-c9f1-4fda-a7b5-34fc5717450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:26.888268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf1ba-c9f1-4fda-a7b5-34fc5717450d admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.888419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf1ba-c9f1-4fda-a7b5-34fc5717450d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.889548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf1ba-c9f1-4fda-a7b5-34fc5717450d admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.890276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abf1ba-c9f1-4fda-a7b5-34fc5717450d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:26.892415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abf1ba-c9f1-4fda-a7b5-34fc5717450d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:26.921311 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 815/1628] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:26.927019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f682b-29e8-4984-b2b5-7e4a3bb71a0e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:26.940299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f682b-29e8-4984-b2b5-7e4a3bb71a0e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:26.945538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f57c1-3ba0-4367-89e4-3201a970cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:26.946279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f57c1-3ba0-4367-89e4-3201a970cecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.950196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f57c1-3ba0-4367-89e4-3201a970cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.950196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f57c1-3ba0-4367-89e4-3201a970cecd admin admin] PATH_INFO: `/v3/projects/6f0172df02a44b9b9bb257de6925f7ee/users/f4c1b11994874bb3855ee16145eb2773/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:26.950820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f57c1-3ba0-4367-89e4-3201a970cecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0172df02a44b9b9bb257de6925f7ee, user_id=f4c1b11994874bb3855ee16145eb2773, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:26.954063 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f57c1-3ba0-4367-89e4-3201a970cecd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:26.970830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 814/1629] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:26 2022] PUT /identity/v3/projects/6f0172df02a44b9b9bb257de6925f7ee/users/f4c1b11994874bb3855ee16145eb2773/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:26.982000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d90a6-cd9a-4976-81a2-5ebf970096f7 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:26.982290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d90a6-cd9a-4976-81a2-5ebf970096f7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:26.982588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d90a6-cd9a-4976-81a2-5ebf970096f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:27.042938 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c25d90a6-cd9a-4976-81a2-5ebf970096f7 None None] MFA Rules not processed for user `f4c1b11994874bb3855ee16145eb2773`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:27.044512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c25d90a6-cd9a-4976-81a2-5ebf970096f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:27.129644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:27.216659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 816/1630] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:27.243560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f57c1-3ba0-4367-89e4-3201a970cecd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:27.254640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:27.343697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f57c1-3ba0-4367-89e4-3201a970cecd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:27.348770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd711c7-2b63-4f49-85ae-9bf832e2cf78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:27.349580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd711c7-2b63-4f49-85ae-9bf832e2cf78 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:27.349965 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd711c7-2b63-4f49-85ae-9bf832e2cf78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:27.350999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd711c7-2b63-4f49-85ae-9bf832e2cf78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:27.362429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd711c7-2b63-4f49-85ae-9bf832e2cf78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:27.370075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd711c7-2b63-4f49-85ae-9bf832e2cf78 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:27.382627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 815/1631] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:27.758947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d90a6-cd9a-4976-81a2-5ebf970096f7 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:27.758947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d90a6-cd9a-4976-81a2-5ebf970096f7 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:27.758947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:27.758947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:27.761015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:27.761015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] PATH_INFO: `/v3/users/500806c13342413983cb8e2c41dc0ef6` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:27.761015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500806c13342413983cb8e2c41dc0ef6)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:27.761015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:28.094796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500806c13342413983cb8e2c41dc0ef6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:28.095998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500806c13342413983cb8e2c41dc0ef6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:28.221248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500806c13342413983cb8e2c41dc0ef6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:28.222438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500806c13342413983cb8e2c41dc0ef6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:28.240270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500806c13342413983cb8e2c41dc0ef6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:28.271760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 817/1632] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:08:27 2022] DELETE /identity/v3/users/500806c13342413983cb8e2c41dc0ef6 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:28.275669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f3a3-8893-464d-809e-1f4b8bb4112b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:28.277050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f3a3-8893-464d-809e-1f4b8bb4112b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:28.277553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f3a3-8893-464d-809e-1f4b8bb4112b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:28.318830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f573f3a3-8893-464d-809e-1f4b8bb4112b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:28.320261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f573f3a3-8893-464d-809e-1f4b8bb4112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:28.481045 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 816/1633] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:28.493083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:28.494863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:28.587461 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:28.598614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db74b8-f445-41ae-9388-d7c6f2ee4977 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:28.602930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed093d0-5fb2-4d3c-869e-ec0de987ae95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:28.603608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed093d0-5fb2-4d3c-869e-ec0de987ae95 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:28.603886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed093d0-5fb2-4d3c-869e-ec0de987ae95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:28.604554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed093d0-5fb2-4d3c-869e-ec0de987ae95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:28.614513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed093d0-5fb2-4d3c-869e-ec0de987ae95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:28.616046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed093d0-5fb2-4d3c-869e-ec0de987ae95 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:28.629053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 818/1634] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:28.810121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42089a-d3da-4c40-b1d4-249b530c2737 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:28.810531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42089a-d3da-4c40-b1d4-249b530c2737 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:28.810690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42089a-d3da-4c40-b1d4-249b530c2737 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:28.812808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 817/1635] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 28 18:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:08:28.822121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d94fad-2bf8-4e10-9f44-344e14c781d4 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:28.822406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d94fad-2bf8-4e10-9f44-344e14c781d4 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:28.822682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d94fad-2bf8-4e10-9f44-344e14c781d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:28.882778 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-92d94fad-2bf8-4e10-9f44-344e14c781d4 None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:28.884905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-92d94fad-2bf8-4e10-9f44-344e14c781d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:29.038305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 819/1636] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 28 18:08:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:29.043506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae51b1-5465-4b1b-a6eb-aaa81a5dd5a4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:29.043789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae51b1-5465-4b1b-a6eb-aaa81a5dd5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:29.044066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae51b1-5465-4b1b-a6eb-aaa81a5dd5a4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:29.045684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 818/1637] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 28 18:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:08:29.051141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154cd55-429f-417b-b8bd-0515ae907d70 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:29.051733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154cd55-429f-417b-b8bd-0515ae907d70 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:29.052152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154cd55-429f-417b-b8bd-0515ae907d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:29.084656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-6154cd55-429f-417b-b8bd-0515ae907d70 None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:29.086279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6154cd55-429f-417b-b8bd-0515ae907d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:29.123977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae51b1-5465-4b1b-a6eb-aaa81a5dd5a4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:29.126724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7dae51b1-5465-4b1b-a6eb-aaa81a5dd5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:29.130528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 820/1638] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:08:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:29.151314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e9c02-8490-4ddd-9264-d1dbe09a5f22 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:29.151746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e9c02-8490-4ddd-9264-d1dbe09a5f22 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:29.152173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e9c02-8490-4ddd-9264-d1dbe09a5f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:29.193671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-159e9c02-8490-4ddd-9264-d1dbe09a5f22 None None] MFA Rules not processed for user `efe43f98c4404fe6a28bb2c0efd28b61`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:29.197689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-159e9c02-8490-4ddd-9264-d1dbe09a5f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:29.290377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae51b1-5465-4b1b-a6eb-aaa81a5dd5a4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:29.299888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc9760-f99c-4ea6-9ecf-ffc89c8c71eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:29.300543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc9760-f99c-4ea6-9ecf-ffc89c8c71eb service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:29.300856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc9760-f99c-4ea6-9ecf-ffc89c8c71eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:29.301133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc9760-f99c-4ea6-9ecf-ffc89c8c71eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:29.326746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc9760-f99c-4ea6-9ecf-ffc89c8c71eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:29.331521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc9760-f99c-4ea6-9ecf-ffc89c8c71eb service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:29.360262 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 821/1639] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:29.362445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e9c02-8490-4ddd-9264-d1dbe09a5f22 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:29.371786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-159e9c02-8490-4ddd-9264-d1dbe09a5f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:29.378281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 819/1640] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:08:29.417877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e9c02-8490-4ddd-9264-d1dbe09a5f22 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:29.430243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bbeb9-2d4e-4d16-b989-b2e9edb3c7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:29.430935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bbeb9-2d4e-4d16-b989-b2e9edb3c7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:29.431527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bbeb9-2d4e-4d16-b989-b2e9edb3c7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:29.431755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bbeb9-2d4e-4d16-b989-b2e9edb3c7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:29.432508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bbeb9-2d4e-4d16-b989-b2e9edb3c7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:29.438299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bbeb9-2d4e-4d16-b989-b2e9edb3c7e8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:29.609349 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 822/1641] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:29 2022] POST /identity/v3/projects => generated 405 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:29.614169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc9760-f99c-4ea6-9ecf-ffc89c8c71eb service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:29.632912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc9760-f99c-4ea6-9ecf-ffc89c8c71eb service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:29.712474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec982-465e-45e2-8b50-0590bf66aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:29.713591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec982-465e-45e2-8b50-0590bf66aabe admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:29.714161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec982-465e-45e2-8b50-0590bf66aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:29.714631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec982-465e-45e2-8b50-0590bf66aabe admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:29.715750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ec982-465e-45e2-8b50-0590bf66aabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:29.718152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ec982-465e-45e2-8b50-0590bf66aabe admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:29.731241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:29.914259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 820/1642] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:29 2022] POST /identity/v3/users => generated 309 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:08:29.918153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bbeb9-2d4e-4d16-b989-b2e9edb3c7e8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:29.939392 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bbeb9-2d4e-4d16-b989-b2e9edb3c7e8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:29.944846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dd42-b739-4e3e-bb40-2a1d267233e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:29.945788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dd42-b739-4e3e-bb40-2a1d267233e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:29.946142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dd42-b739-4e3e-bb40-2a1d267233e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:29.946481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dd42-b739-4e3e-bb40-2a1d267233e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:29.947347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7dd42-b739-4e3e-bb40-2a1d267233e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:29.949010 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7dd42-b739-4e3e-bb40-2a1d267233e6 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:29.961925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 823/1643] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:08:29.966083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec982-465e-45e2-8b50-0590bf66aabe admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:29.986369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec982-465e-45e2-8b50-0590bf66aabe admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:29.994141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61103-1cf2-4cd6-b039-8ba223722463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:29.995708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61103-1cf2-4cd6-b039-8ba223722463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:29.996088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61103-1cf2-4cd6-b039-8ba223722463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:29.996573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd61103-1cf2-4cd6-b039-8ba223722463 admin admin] PATH_INFO: `/v3/projects/bbcf47712066406ab1f9acf5874fc65e/users/73b33ff38f4d4b0cb2ab9194dce59a96/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:30.019863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd61103-1cf2-4cd6-b039-8ba223722463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcf47712066406ab1f9acf5874fc65e, user_id=73b33ff38f4d4b0cb2ab9194dce59a96, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:30.025361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd61103-1cf2-4cd6-b039-8ba223722463 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:30.146996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 821/1644] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:29 2022] PUT /identity/v3/projects/bbcf47712066406ab1f9acf5874fc65e/users/73b33ff38f4d4b0cb2ab9194dce59a96/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:30.151417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dd42-b739-4e3e-bb40-2a1d267233e6 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:30.176412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dd42-b739-4e3e-bb40-2a1d267233e6 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:30.279975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b2b30-5089-4804-b27f-fea65e233faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:30.281184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b2b30-5089-4804-b27f-fea65e233faa admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:30.281498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b2b30-5089-4804-b27f-fea65e233faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:30.281783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b2b30-5089-4804-b27f-fea65e233faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:30.282599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b2b30-5089-4804-b27f-fea65e233faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:30.284311 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b2b30-5089-4804-b27f-fea65e233faa admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:30.316864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 824/1645] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:30.318603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61103-1cf2-4cd6-b039-8ba223722463 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:30.331660 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd61103-1cf2-4cd6-b039-8ba223722463 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:30.340402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846cc12-f981-46d8-8eb5-17da07ac5826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:30.341588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846cc12-f981-46d8-8eb5-17da07ac5826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:30.342149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846cc12-f981-46d8-8eb5-17da07ac5826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:30.342605 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846cc12-f981-46d8-8eb5-17da07ac5826 admin admin] PATH_INFO: `/v3/projects/bbcf47712066406ab1f9acf5874fc65e/users/73b33ff38f4d4b0cb2ab9194dce59a96/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:30.344990 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846cc12-f981-46d8-8eb5-17da07ac5826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcf47712066406ab1f9acf5874fc65e, user_id=73b33ff38f4d4b0cb2ab9194dce59a96, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:30.348082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846cc12-f981-46d8-8eb5-17da07ac5826 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:30.393006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 822/1646] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:30 2022] PUT /identity/v3/projects/bbcf47712066406ab1f9acf5874fc65e/users/73b33ff38f4d4b0cb2ab9194dce59a96/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:30.588266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b2b30-5089-4804-b27f-fea65e233faa admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:30.591157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7c7b2b30-5089-4804-b27f-fea65e233faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:30.624317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b2b30-5089-4804-b27f-fea65e233faa admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:30.753846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:30.754512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:30.754799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:30.755138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] PATH_INFO: `/v3/projects/dae3bde91381450fbd425643111d2aaf` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:30.758985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae3bde91381450fbd425643111d2aaf)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:30.762854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: WARNING py.warnings [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:08:30.762854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: warnings.warn(msg) Jul 28 18:08:30.762854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: Jul 28 18:08:30.771841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:31.072165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae3bde91381450fbd425643111d2aaf', 'request_id': 'req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:31.079241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae3bde91381450fbd425643111d2aaf', 'request_id': 'req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:31.215581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae3bde91381450fbd425643111d2aaf', 'request_id': 'req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:31.330323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] The token cache is being invalidate because project dae3bde91381450fbd425643111d2aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:08:31.330838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:31.336922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:31.357334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 825/1647] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:08:30 2022] DELETE /identity/v3/projects/dae3bde91381450fbd425643111d2aaf => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:31.364607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846cc12-f981-46d8-8eb5-17da07ac5826 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:31.367264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c846cc12-f981-46d8-8eb5-17da07ac5826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:31.397982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846cc12-f981-46d8-8eb5-17da07ac5826 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:31.602770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:31.604083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:31.604628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:31.605095 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] PATH_INFO: `/v3/users/f4c1b11994874bb3855ee16145eb2773` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:31.606580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c1b11994874bb3855ee16145eb2773)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:31.607906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:08:31.607906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: warnings.warn(msg) Jul 28 18:08:31.607906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: Jul 28 18:08:31.609932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:31.696865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:31.927720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c1b11994874bb3855ee16145eb2773'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:31.930444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c1b11994874bb3855ee16145eb2773'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:31.995784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c1b11994874bb3855ee16145eb2773'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:32.005810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c1b11994874bb3855ee16145eb2773'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:32.069952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6dc597ef-546b-4732-a4b9-f95932070f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c1b11994874bb3855ee16145eb2773'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:32.197025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 823/1648] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:08:31 2022] DELETE /identity/v3/users/f4c1b11994874bb3855ee16145eb2773 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:32.458089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:32.459601 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:32.530778 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcabe73-b0a1-4ff9-a0fc-81d710681b20 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:32.718825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:32.720176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:32.720937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:32.728265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] PATH_INFO: `/v3/users/2d7b5ebb4e7a493ab8e3136783c3bcb3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:32.729695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7b5ebb4e7a493ab8e3136783c3bcb3)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:32.738796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:33.032933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7b5ebb4e7a493ab8e3136783c3bcb3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:33.034756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7b5ebb4e7a493ab8e3136783c3bcb3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:33.152412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7b5ebb4e7a493ab8e3136783c3bcb3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:33.153745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7b5ebb4e7a493ab8e3136783c3bcb3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:33.181102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7b5ebb4e7a493ab8e3136783c3bcb3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:33.212037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 826/1649] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:08:32 2022] DELETE /identity/v3/users/2d7b5ebb4e7a493ab8e3136783c3bcb3 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:33.219399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4b58-5f2c-480b-877f-d401f03b353e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:33.221027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4b58-5f2c-480b-877f-d401f03b353e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:33.221529 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4b58-5f2c-480b-877f-d401f03b353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:33.249363 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:33.251646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3fed4b58-5f2c-480b-877f-d401f03b353e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:33.252946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3fed4b58-5f2c-480b-877f-d401f03b353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:33.286882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=6,keystone:SELECT=84,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:33.331070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 824/1650] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:33.356193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:33.357771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:33.487692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90656b8-2621-4cbf-a627-31867e6e0abb admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:33.505143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9324827-1dd9-42f3-a761-071efd5961f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:33.505826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9324827-1dd9-42f3-a761-071efd5961f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:33.506107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9324827-1dd9-42f3-a761-071efd5961f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:33.506577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9324827-1dd9-42f3-a761-071efd5961f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:33.535213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9324827-1dd9-42f3-a761-071efd5961f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:33.536709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9324827-1dd9-42f3-a761-071efd5961f3 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:33.564474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 827/1651] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:34.030121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4b58-5f2c-480b-877f-d401f03b353e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:34.031661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3fed4b58-5f2c-480b-877f-d401f03b353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:34.051437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4b58-5f2c-480b-877f-d401f03b353e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:34.066709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:34.067646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:34.068111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:34.068644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] PATH_INFO: `/v3/projects/6f0172df02a44b9b9bb257de6925f7ee` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:34.073673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0172df02a44b9b9bb257de6925f7ee)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:34.077831 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:34.353640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0172df02a44b9b9bb257de6925f7ee', 'request_id': 'req-67fb3621-f031-4f29-85a4-ab2087072177'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:34.496088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0172df02a44b9b9bb257de6925f7ee', 'request_id': 'req-67fb3621-f031-4f29-85a4-ab2087072177'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:34.505929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0172df02a44b9b9bb257de6925f7ee', 'request_id': 'req-67fb3621-f031-4f29-85a4-ab2087072177'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:34.520157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72203ebe-5c19-4f7c-8286-b2039b4b8a33 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:34.521260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72203ebe-5c19-4f7c-8286-b2039b4b8a33 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:34.521845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72203ebe-5c19-4f7c-8286-b2039b4b8a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:34.541178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] The token cache is being invalidate because project 6f0172df02a44b9b9bb257de6925f7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:08:34.541473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:34.543797 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fb3621-f031-4f29-85a4-ab2087072177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:34.546850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 825/1652] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:08:34 2022] DELETE /identity/v3/projects/6f0172df02a44b9b9bb257de6925f7ee => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:08:34.552752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512963f-3792-44a6-a956-df4a1d82a477 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:34.553825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512963f-3792-44a6-a956-df4a1d82a477 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:34.554246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512963f-3792-44a6-a956-df4a1d82a477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:34.592064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-72203ebe-5c19-4f7c-8286-b2039b4b8a33 None None] MFA Rules not processed for user `73b33ff38f4d4b0cb2ab9194dce59a96`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:34.596970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-72203ebe-5c19-4f7c-8286-b2039b4b8a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:34.598276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7512963f-3792-44a6-a956-df4a1d82a477 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:34.603078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7512963f-3792-44a6-a956-df4a1d82a477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:34.749003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 826/1653] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:34.760388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649c09-f37e-4334-910e-6f05625d479a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:34.761014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649c09-f37e-4334-910e-6f05625d479a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:34.761570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf649c09-f37e-4334-910e-6f05625d479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:34.807221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bf649c09-f37e-4334-910e-6f05625d479a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:34.810548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bf649c09-f37e-4334-910e-6f05625d479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:34.811992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 828/1654] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:34.827463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 827/1655] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:34.834633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72203ebe-5c19-4f7c-8286-b2039b4b8a33 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:34.849474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72203ebe-5c19-4f7c-8286-b2039b4b8a33 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:34.855545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47417d9-8b05-4edf-a3c8-0e65de3c1d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:34.856498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47417d9-8b05-4edf-a3c8-0e65de3c1d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:34.857011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47417d9-8b05-4edf-a3c8-0e65de3c1d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:34.857527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47417d9-8b05-4edf-a3c8-0e65de3c1d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:34.858487 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47417d9-8b05-4edf-a3c8-0e65de3c1d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:34.858987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47417d9-8b05-4edf-a3c8-0e65de3c1d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:34.861171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47417d9-8b05-4edf-a3c8-0e65de3c1d50 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:34.881046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 829/1656] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:34.887194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf649c09-f37e-4334-910e-6f05625d479a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:34.898518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf649c09-f37e-4334-910e-6f05625d479a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:34.912724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9b1f7-059e-4bbc-a7a6-c79b0e04dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:34.913790 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b1f7-059e-4bbc-a7a6-c79b0e04dbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:34.914318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b1f7-059e-4bbc-a7a6-c79b0e04dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:34.914794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b1f7-059e-4bbc-a7a6-c79b0e04dbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:34.915640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9b1f7-059e-4bbc-a7a6-c79b0e04dbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:34.917764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9b1f7-059e-4bbc-a7a6-c79b0e04dbb2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:35.046487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 828/1657] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:34 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:35.050659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47417d9-8b05-4edf-a3c8-0e65de3c1d50 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:35.062021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47417d9-8b05-4edf-a3c8-0e65de3c1d50 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:35.066256 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:35.178734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679903d-1561-4807-9cb0-e202cba18f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:35.179976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679903d-1561-4807-9cb0-e202cba18f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:35.180395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679903d-1561-4807-9cb0-e202cba18f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:35.182226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679903d-1561-4807-9cb0-e202cba18f77 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:35.183223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679903d-1561-4807-9cb0-e202cba18f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:35.200934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679903d-1561-4807-9cb0-e202cba18f77 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:35.214248 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9b1f7-059e-4bbc-a7a6-c79b0e04dbb2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:35.216180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-92a9b1f7-059e-4bbc-a7a6-c79b0e04dbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:35.232002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9b1f7-059e-4bbc-a7a6-c79b0e04dbb2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:35.237498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:35.238389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:35.238814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:35.239226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] PATH_INFO: `/v3/projects/23e92273786a4521b8cefefd5b466f14` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:35.241267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e92273786a4521b8cefefd5b466f14)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:35.243601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:35.417198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 830/1658] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:35 2022] POST /identity/v3/users => generated 293 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:35.421710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:35.439571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679903d-1561-4807-9cb0-e202cba18f77 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:35.452269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e92273786a4521b8cefefd5b466f14', 'request_id': 'req-77ce292f-ec7b-49c6-a900-9b0737d2335d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:35.453493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679903d-1561-4807-9cb0-e202cba18f77 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:35.545022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21af82-e6eb-42e4-a68a-f55bedb542b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:35.552918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21af82-e6eb-42e4-a68a-f55bedb542b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:35.552918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21af82-e6eb-42e4-a68a-f55bedb542b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:35.552918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21af82-e6eb-42e4-a68a-f55bedb542b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:35.552918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21af82-e6eb-42e4-a68a-f55bedb542b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:35.554376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21af82-e6eb-42e4-a68a-f55bedb542b4 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:35.566931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 831/1659] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:35.571299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21af82-e6eb-42e4-a68a-f55bedb542b4 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:35.579663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e92273786a4521b8cefefd5b466f14', 'request_id': 'req-77ce292f-ec7b-49c6-a900-9b0737d2335d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:35.585917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21af82-e6eb-42e4-a68a-f55bedb542b4 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:35.587516 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e92273786a4521b8cefefd5b466f14', 'request_id': 'req-77ce292f-ec7b-49c6-a900-9b0737d2335d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:35.594136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed31de3-8e74-4eed-9d09-4ceb6d63e70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:35.595910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed31de3-8e74-4eed-9d09-4ceb6d63e70d admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:35.596347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed31de3-8e74-4eed-9d09-4ceb6d63e70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:35.596930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed31de3-8e74-4eed-9d09-4ceb6d63e70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:35.597993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed31de3-8e74-4eed-9d09-4ceb6d63e70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:35.602099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed31de3-8e74-4eed-9d09-4ceb6d63e70d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:35.627477 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 832/1660] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:35.629339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] The token cache is being invalidate because project 23e92273786a4521b8cefefd5b466f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:08:35.629794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:35.632121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed31de3-8e74-4eed-9d09-4ceb6d63e70d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:35.640832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-77ce292f-ec7b-49c6-a900-9b0737d2335d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:35.641052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5ed31de3-8e74-4eed-9d09-4ceb6d63e70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:35.644593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 829/1661] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:08:35 2022] DELETE /identity/v3/projects/23e92273786a4521b8cefefd5b466f14 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:35.646281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c749f7-3ace-4f1b-8313-13e62564ebbe None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:35.646732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c749f7-3ace-4f1b-8313-13e62564ebbe None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:35.647727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c749f7-3ace-4f1b-8313-13e62564ebbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:35.673624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed31de3-8e74-4eed-9d09-4ceb6d63e70d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:35.686980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b0991-1445-4722-8c92-7582571c0f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:35.687755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b0991-1445-4722-8c92-7582571c0f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:35.688104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b0991-1445-4722-8c92-7582571c0f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:35.688587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b0991-1445-4722-8c92-7582571c0f2c admin admin] PATH_INFO: `/v3/projects/71534537093d4ea7a543c5ce5de58e11/users/ef5d98d843b94ef090d48c78e7cc478a/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:35.704985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-46c749f7-3ace-4f1b-8313-13e62564ebbe None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:35.706464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-46c749f7-3ace-4f1b-8313-13e62564ebbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:35.738367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b0991-1445-4722-8c92-7582571c0f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71534537093d4ea7a543c5ce5de58e11, user_id=ef5d98d843b94ef090d48c78e7cc478a, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:35.739576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 830/1662] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:35.742097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1814-5327-476a-bc47-9904b8025f28 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:35.742559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1814-5327-476a-bc47-9904b8025f28 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:35.742975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1814-5327-476a-bc47-9904b8025f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:35.752436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b0991-1445-4722-8c92-7582571c0f2c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:35.786534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d90a1814-5327-476a-bc47-9904b8025f28 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:35.787816 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d90a1814-5327-476a-bc47-9904b8025f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:35.814867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 831/1663] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:35.815863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a1814-5327-476a-bc47-9904b8025f28 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:35.838010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a1814-5327-476a-bc47-9904b8025f28 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:35.852024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c20a5-bacc-461a-8f40-3cac35dde6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:35.852671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c20a5-bacc-461a-8f40-3cac35dde6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:35.853019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c20a5-bacc-461a-8f40-3cac35dde6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:35.853301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c20a5-bacc-461a-8f40-3cac35dde6f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:35.854012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c20a5-bacc-461a-8f40-3cac35dde6f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:35.854318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c20a5-bacc-461a-8f40-3cac35dde6f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:35.855951 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c20a5-bacc-461a-8f40-3cac35dde6f6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:35.871853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 832/1664] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:35.876496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c20a5-bacc-461a-8f40-3cac35dde6f6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:35.889419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c20a5-bacc-461a-8f40-3cac35dde6f6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:35.896913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 833/1665] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:35 2022] PUT /identity/v3/projects/71534537093d4ea7a543c5ce5de58e11/users/ef5d98d843b94ef090d48c78e7cc478a/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:08:35.908142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da59b76-6bbe-4d6c-bf7a-b3ba7f3d1cfe None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:35.908581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da59b76-6bbe-4d6c-bf7a-b3ba7f3d1cfe None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:35.909004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da59b76-6bbe-4d6c-bf7a-b3ba7f3d1cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:35.976310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9da59b76-6bbe-4d6c-bf7a-b3ba7f3d1cfe None None] MFA Rules not processed for user `ef5d98d843b94ef090d48c78e7cc478a`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:35.979123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9da59b76-6bbe-4d6c-bf7a-b3ba7f3d1cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:36.035190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd69e4f-d7a5-4297-a7fd-21c9488080e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.036144 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd69e4f-d7a5-4297-a7fd-21c9488080e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.036733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd69e4f-d7a5-4297-a7fd-21c9488080e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.037349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd69e4f-d7a5-4297-a7fd-21c9488080e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.038200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd69e4f-d7a5-4297-a7fd-21c9488080e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.040269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd69e4f-d7a5-4297-a7fd-21c9488080e6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:36.139942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 834/1666] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:36.146813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da59b76-6bbe-4d6c-bf7a-b3ba7f3d1cfe None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:36.175437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 833/1667] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:35 2022] POST /identity/v3/projects => generated 381 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:08:36.177759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da59b76-6bbe-4d6c-bf7a-b3ba7f3d1cfe None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:36.184141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd69e4f-d7a5-4297-a7fd-21c9488080e6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:36.259512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26afa-cee4-4111-8174-50ddafefcdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.260389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26afa-cee4-4111-8174-50ddafefcdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.260818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26afa-cee4-4111-8174-50ddafefcdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.261172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26afa-cee4-4111-8174-50ddafefcdb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.262012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26afa-cee4-4111-8174-50ddafefcdb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.264831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26afa-cee4-4111-8174-50ddafefcdb9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:36.309249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd69e4f-d7a5-4297-a7fd-21c9488080e6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:36.314899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e054e7-e584-45ae-b5dd-4b4a3b54f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.316225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e054e7-e584-45ae-b5dd-4b4a3b54f8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.316710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e054e7-e584-45ae-b5dd-4b4a3b54f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.317218 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e054e7-e584-45ae-b5dd-4b4a3b54f8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.318067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e054e7-e584-45ae-b5dd-4b4a3b54f8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.320226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e054e7-e584-45ae-b5dd-4b4a3b54f8e6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:36.399050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 835/1668] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:36 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:36.403793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26afa-cee4-4111-8174-50ddafefcdb9 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:36.424956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 834/1669] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:36 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:36.426487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e054e7-e584-45ae-b5dd-4b4a3b54f8e6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:36.446942 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e054e7-e584-45ae-b5dd-4b4a3b54f8e6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:36.542389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26afa-cee4-4111-8174-50ddafefcdb9 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:36.555086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72b69a-f85a-4e74-bc0a-275d5875166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.556705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72b69a-f85a-4e74-bc0a-275d5875166b admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.558002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72b69a-f85a-4e74-bc0a-275d5875166b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.560855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72b69a-f85a-4e74-bc0a-275d5875166b admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.561739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72b69a-f85a-4e74-bc0a-275d5875166b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.565008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72b69a-f85a-4e74-bc0a-275d5875166b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:36.576652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cbe8d-8e81-42d8-ad6c-4fffa2befc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.577623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cbe8d-8e81-42d8-ad6c-4fffa2befc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.578162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cbe8d-8e81-42d8-ad6c-4fffa2befc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.578569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cbe8d-8e81-42d8-ad6c-4fffa2befc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.579482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cbe8d-8e81-42d8-ad6c-4fffa2befc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.581288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cbe8d-8e81-42d8-ad6c-4fffa2befc84 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:36.600702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 835/1670] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:36.606003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cbe8d-8e81-42d8-ad6c-4fffa2befc84 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:36.619984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cbe8d-8e81-42d8-ad6c-4fffa2befc84 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:36.626452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f7cce-e7b4-42ee-a5ab-51cd8884e64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.627454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f7cce-e7b4-42ee-a5ab-51cd8884e64a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.628163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f7cce-e7b4-42ee-a5ab-51cd8884e64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.628583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f7cce-e7b4-42ee-a5ab-51cd8884e64a admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.629566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f7cce-e7b4-42ee-a5ab-51cd8884e64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.633369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f7cce-e7b4-42ee-a5ab-51cd8884e64a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:36.649180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 836/1671] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:08:36.653908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f7cce-e7b4-42ee-a5ab-51cd8884e64a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:36.665551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f7cce-e7b4-42ee-a5ab-51cd8884e64a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:36.671814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629ea6b-b0ff-4e4d-9033-30f252aeb759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.672846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ea6b-b0ff-4e4d-9033-30f252aeb759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.673271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ea6b-b0ff-4e4d-9033-30f252aeb759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.673954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ea6b-b0ff-4e4d-9033-30f252aeb759 admin admin] PATH_INFO: `/v3/projects/69d9a6abc7e348ccbe17ae070021738d/users/0df038ecdf084422af24a96616d566d2/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.691211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 836/1672] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:36 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:36.701665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72b69a-f85a-4e74-bc0a-275d5875166b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:36.718161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72b69a-f85a-4e74-bc0a-275d5875166b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:36.727382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629ea6b-b0ff-4e4d-9033-30f252aeb759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d9a6abc7e348ccbe17ae070021738d, user_id=0df038ecdf084422af24a96616d566d2, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.732326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb754f-6b0e-4b62-aa8e-101aba879c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.733800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb754f-6b0e-4b62-aa8e-101aba879c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.735297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629ea6b-b0ff-4e4d-9033-30f252aeb759 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:36.735784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb754f-6b0e-4b62-aa8e-101aba879c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.736637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb754f-6b0e-4b62-aa8e-101aba879c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.737526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb754f-6b0e-4b62-aa8e-101aba879c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.743430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb754f-6b0e-4b62-aa8e-101aba879c91 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:36.759085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 837/1673] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:36.764353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb754f-6b0e-4b62-aa8e-101aba879c91 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:36.778321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb754f-6b0e-4b62-aa8e-101aba879c91 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:36.784828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d7b86-8708-4936-91bd-2e5fe3ee9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.785749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d7b86-8708-4936-91bd-2e5fe3ee9939 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.786258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d7b86-8708-4936-91bd-2e5fe3ee9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.786678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d7b86-8708-4936-91bd-2e5fe3ee9939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.789342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d7b86-8708-4936-91bd-2e5fe3ee9939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.791663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d7b86-8708-4936-91bd-2e5fe3ee9939 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:36.810939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 838/1674] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:36.812423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d7b86-8708-4936-91bd-2e5fe3ee9939 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:36.821143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 837/1675] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:36 2022] PUT /identity/v3/projects/69d9a6abc7e348ccbe17ae070021738d/users/0df038ecdf084422af24a96616d566d2/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:36.832388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403e377-88f2-4f1a-bacc-ab3cf08a7d44 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.832944 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403e377-88f2-4f1a-bacc-ab3cf08a7d44 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.833498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403e377-88f2-4f1a-bacc-ab3cf08a7d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.851456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d7b86-8708-4936-91bd-2e5fe3ee9939 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:36.899995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6403e377-88f2-4f1a-bacc-ab3cf08a7d44 None None] MFA Rules not processed for user `0df038ecdf084422af24a96616d566d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:36.901251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6403e377-88f2-4f1a-bacc-ab3cf08a7d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:36.939302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a65465-c488-4805-a7e6-c1c8aebb3751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:36.940158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65465-c488-4805-a7e6-c1c8aebb3751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:36.940459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65465-c488-4805-a7e6-c1c8aebb3751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:36.940741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65465-c488-4805-a7e6-c1c8aebb3751 admin admin] PATH_INFO: `/v3/projects/a87ec4749856445dacabd4d13d9b3c3c/users/54fd2b67559343c6babd59e686be8eab/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:36.969843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a65465-c488-4805-a7e6-c1c8aebb3751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87ec4749856445dacabd4d13d9b3c3c, user_id=54fd2b67559343c6babd59e686be8eab, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:36.972798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a65465-c488-4805-a7e6-c1c8aebb3751 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:37.023173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 838/1676] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:37.030456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403e377-88f2-4f1a-bacc-ab3cf08a7d44 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:37.044099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403e377-88f2-4f1a-bacc-ab3cf08a7d44 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:37.057508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 839/1677] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:36 2022] PUT /identity/v3/projects/a87ec4749856445dacabd4d13d9b3c3c/users/54fd2b67559343c6babd59e686be8eab/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:37.067546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac17f-5017-4e58-9d0b-3c8c6df0181a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:37.067546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac17f-5017-4e58-9d0b-3c8c6df0181a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.067546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac17f-5017-4e58-9d0b-3c8c6df0181a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.067546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac17f-5017-4e58-9d0b-3c8c6df0181a admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.067926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ac17f-5017-4e58-9d0b-3c8c6df0181a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:37.067926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ac17f-5017-4e58-9d0b-3c8c6df0181a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:37.072421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd58ca2-3f33-4c6c-b663-8b5b3a526e33 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.073026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd58ca2-3f33-4c6c-b663-8b5b3a526e33 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.073535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd58ca2-3f33-4c6c-b663-8b5b3a526e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.111962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-cbd58ca2-3f33-4c6c-b663-8b5b3a526e33 None None] MFA Rules not processed for user `54fd2b67559343c6babd59e686be8eab`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:37.113949 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cbd58ca2-3f33-4c6c-b663-8b5b3a526e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:37.138295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:37.184595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 839/1678] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:37 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:37.186929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac17f-5017-4e58-9d0b-3c8c6df0181a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:37.244066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 840/1679] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:37.248900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd58ca2-3f33-4c6c-b663-8b5b3a526e33 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:37.249608 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:37.278864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac17f-5017-4e58-9d0b-3c8c6df0181a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:37.284774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6982240-832f-4360-8ba0-fa03c2410adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:37.285434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982240-832f-4360-8ba0-fa03c2410adf admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.285863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982240-832f-4360-8ba0-fa03c2410adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.286291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982240-832f-4360-8ba0-fa03c2410adf admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.287127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6982240-832f-4360-8ba0-fa03c2410adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:37.289399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6982240-832f-4360-8ba0-fa03c2410adf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:37.337253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd58ca2-3f33-4c6c-b663-8b5b3a526e33 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:37.343717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88ddd7-8cb8-4b1b-96d3-271ecca789dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:37.346273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88ddd7-8cb8-4b1b-96d3-271ecca789dd admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.346273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88ddd7-8cb8-4b1b-96d3-271ecca789dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.346273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88ddd7-8cb8-4b1b-96d3-271ecca789dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.348738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88ddd7-8cb8-4b1b-96d3-271ecca789dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:37.351610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88ddd7-8cb8-4b1b-96d3-271ecca789dd admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:37.421916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 840/1680] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:37 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:37.425906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6982240-832f-4360-8ba0-fa03c2410adf admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:37.447258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6982240-832f-4360-8ba0-fa03c2410adf admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:37.452411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022a0f-687a-46b4-8a03-f77afcc21b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:37.453187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022a0f-687a-46b4-8a03-f77afcc21b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.454137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022a0f-687a-46b4-8a03-f77afcc21b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.454515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022a0f-687a-46b4-8a03-f77afcc21b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.455341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd022a0f-687a-46b4-8a03-f77afcc21b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:37.457230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd022a0f-687a-46b4-8a03-f77afcc21b29 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:37.478455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 841/1681] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:37.478455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022a0f-687a-46b4-8a03-f77afcc21b29 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:37.513142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022a0f-687a-46b4-8a03-f77afcc21b29 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:37.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0e29-15b2-4246-905b-235ff6f768b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:37.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0e29-15b2-4246-905b-235ff6f768b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.530129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0e29-15b2-4246-905b-235ff6f768b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.530491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 841/1682] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:37 2022] POST /identity/v3/projects => generated 387 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:37.530641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0e29-15b2-4246-905b-235ff6f768b9 admin admin] PATH_INFO: `/v3/projects/dc66da9fb9e74656b343a0097c509957/users/aa082b197b1c4c0bbf0bb3be87b949f7/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.530730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88ddd7-8cb8-4b1b-96d3-271ecca789dd admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:37.579740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a0e29-15b2-4246-905b-235ff6f768b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc66da9fb9e74656b343a0097c509957, user_id=aa082b197b1c4c0bbf0bb3be87b949f7, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:37.588042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a0e29-15b2-4246-905b-235ff6f768b9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:37.709543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88ddd7-8cb8-4b1b-96d3-271ecca789dd admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:37.737868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 842/1683] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:37 2022] PUT /identity/v3/projects/dc66da9fb9e74656b343a0097c509957/users/aa082b197b1c4c0bbf0bb3be87b949f7/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:37.742922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2dbd2-6229-4023-99a4-289fbdf4e46b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.742922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2dbd2-6229-4023-99a4-289fbdf4e46b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.742922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2dbd2-6229-4023-99a4-289fbdf4e46b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.745975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 843/1684] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:08:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:08:37.746819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2dbd2-6229-4023-99a4-289fbdf4e46b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:37.824823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ac3c-5fc7-42ee-9b4f-06125ea97e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:37.826438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ac3c-5fc7-42ee-9b4f-06125ea97e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.826438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ac3c-5fc7-42ee-9b4f-06125ea97e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.826438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ac3c-5fc7-42ee-9b4f-06125ea97e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.833911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32ac3c-5fc7-42ee-9b4f-06125ea97e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:37.854231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32ac3c-5fc7-42ee-9b4f-06125ea97e56 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:37.898422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2dbd2-6229-4023-99a4-289fbdf4e46b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:37.910596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08953bb-e90f-409a-a3c5-fb0ab3daf8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:37.913696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08953bb-e90f-409a-a3c5-fb0ab3daf8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.914415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08953bb-e90f-409a-a3c5-fb0ab3daf8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.915813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08953bb-e90f-409a-a3c5-fb0ab3daf8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.916742 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08953bb-e90f-409a-a3c5-fb0ab3daf8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:37.921087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08953bb-e90f-409a-a3c5-fb0ab3daf8aa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:37.946578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 844/1685] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:37.948466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ddf78-a7df-41b4-81fb-e81fd2ec1287 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:37.949573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ddf78-a7df-41b4-81fb-e81fd2ec1287 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:37.949872 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ddf78-a7df-41b4-81fb-e81fd2ec1287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:37.979254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 842/1686] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:37 2022] POST /identity/v3/users => generated 300 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:37.980091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ac3c-5fc7-42ee-9b4f-06125ea97e56 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:38.002081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-011ddf78-a7df-41b4-81fb-e81fd2ec1287 None None] MFA Rules not processed for user `4dded05b23a0469785e3a7bedf1cf851`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:38.005037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-011ddf78-a7df-41b4-81fb-e81fd2ec1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:38.008521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ac3c-5fc7-42ee-9b4f-06125ea97e56 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:38.026527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c7eaa-6c69-42bf-b365-3e46759b5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:38.027593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7eaa-6c69-42bf-b365-3e46759b5f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:38.029469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7eaa-6c69-42bf-b365-3e46759b5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:38.029828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7eaa-6c69-42bf-b365-3e46759b5f75 admin admin] PATH_INFO: `/v3/projects/dc66da9fb9e74656b343a0097c509957/users/aa082b197b1c4c0bbf0bb3be87b949f7/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:38.036377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c7eaa-6c69-42bf-b365-3e46759b5f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc66da9fb9e74656b343a0097c509957, user_id=aa082b197b1c4c0bbf0bb3be87b949f7, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:38.046411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c7eaa-6c69-42bf-b365-3e46759b5f75 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:38.098594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 843/1687] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:37 2022] PUT /identity/v3/projects/dc66da9fb9e74656b343a0097c509957/users/aa082b197b1c4c0bbf0bb3be87b949f7/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:38.101860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c7eaa-6c69-42bf-b365-3e46759b5f75 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:38.159443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 845/1688] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:08:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:38.162054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2da34-c7ba-4fdf-8a0f-0fbd20e86185 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:38.162535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2da34-c7ba-4fdf-8a0f-0fbd20e86185 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:38.162973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2da34-c7ba-4fdf-8a0f-0fbd20e86185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:38.191735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:38.210163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5ef2da34-c7ba-4fdf-8a0f-0fbd20e86185 None None] MFA Rules not processed for user `aa082b197b1c4c0bbf0bb3be87b949f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:38.212501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5ef2da34-c7ba-4fdf-8a0f-0fbd20e86185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:38.246323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c7eaa-6c69-42bf-b365-3e46759b5f75 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:38.258168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331dfab-99b5-47d5-947e-aa6a69d0f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:38.259178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331dfab-99b5-47d5-947e-aa6a69d0f02c admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:38.259671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331dfab-99b5-47d5-947e-aa6a69d0f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:38.261321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331dfab-99b5-47d5-947e-aa6a69d0f02c admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:38.262181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331dfab-99b5-47d5-947e-aa6a69d0f02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:38.264196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331dfab-99b5-47d5-947e-aa6a69d0f02c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:38.282396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 844/1689] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:38.284667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3db74-a2c9-4d45-8213-47be1c5fc517 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:38.285909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3db74-a2c9-4d45-8213-47be1c5fc517 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:38.287785 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3db74-a2c9-4d45-8213-47be1c5fc517 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:38.293884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 845/1690] 10.222.0.67 () {54 vars in 961 bytes} [Thu Jul 28 18:08:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:08:38.294880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3db74-a2c9-4d45-8213-47be1c5fc517 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:38.345257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3db74-a2c9-4d45-8213-47be1c5fc517 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:38.354795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433a80-7577-4098-af0e-9499ae88370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:38.355401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433a80-7577-4098-af0e-9499ae88370f admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:38.355678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433a80-7577-4098-af0e-9499ae88370f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:38.355951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433a80-7577-4098-af0e-9499ae88370f admin admin] PATH_INFO: `/v3/projects/aaac9b187b70474180b16efd4dfde1b4/users/216772204be1430597b0fb9488638386/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:38.357827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 846/1691] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:38.364081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddb68f-121e-4b26-beb9-6e4782ecef9f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:38.364081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddb68f-121e-4b26-beb9-6e4782ecef9f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:38.364081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddb68f-121e-4b26-beb9-6e4782ecef9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:38.387532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7433a80-7577-4098-af0e-9499ae88370f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaac9b187b70474180b16efd4dfde1b4, user_id=216772204be1430597b0fb9488638386, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:38.391669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7433a80-7577-4098-af0e-9499ae88370f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:38.430783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c5ddb68f-121e-4b26-beb9-6e4782ecef9f None None] MFA Rules not processed for user `4dded05b23a0469785e3a7bedf1cf851`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:38.435162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c5ddb68f-121e-4b26-beb9-6e4782ecef9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:38.485613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 846/1692] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:38 2022] PUT /identity/v3/projects/aaac9b187b70474180b16efd4dfde1b4/users/216772204be1430597b0fb9488638386/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:38.487625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433a80-7577-4098-af0e-9499ae88370f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:38.490573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c7433a80-7577-4098-af0e-9499ae88370f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:38.612614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 847/1693] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Jul 28 18:08:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:38.614203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddb68f-121e-4b26-beb9-6e4782ecef9f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:38.628033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433a80-7577-4098-af0e-9499ae88370f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:38.629587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddb68f-121e-4b26-beb9-6e4782ecef9f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:38.654191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25673d-a513-49e2-90ae-82e774669750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:38.657194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25673d-a513-49e2-90ae-82e774669750 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:38.661619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25673d-a513-49e2-90ae-82e774669750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:38.662691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25673d-a513-49e2-90ae-82e774669750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:38.821728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:38.826541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a583eb-0d85-4a62-ac32-d4bac6bcd842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:38.830794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a583eb-0d85-4a62-ac32-d4bac6bcd842 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:38.832206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a583eb-0d85-4a62-ac32-d4bac6bcd842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:38.833221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a583eb-0d85-4a62-ac32-d4bac6bcd842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:38.836442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a583eb-0d85-4a62-ac32-d4bac6bcd842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:38.839345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a583eb-0d85-4a62-ac32-d4bac6bcd842 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:38.858973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25673d-a513-49e2-90ae-82e774669750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:38.865033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25673d-a513-49e2-90ae-82e774669750 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:38.870272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 848/1694] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:38.871605 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a583eb-0d85-4a62-ac32-d4bac6bcd842 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:38.891200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 847/1695] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:38.907003 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25673d-a513-49e2-90ae-82e774669750 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:38.946233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25673d-a513-49e2-90ae-82e774669750 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:38.994395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f32b-67f6-4438-a0cb-7f32cd4f1550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:38.995109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f32b-67f6-4438-a0cb-7f32cd4f1550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:38.996919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f32b-67f6-4438-a0cb-7f32cd4f1550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:39.001182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f32b-67f6-4438-a0cb-7f32cd4f1550 admin admin] PATH_INFO: `/v3/projects/aaac9b187b70474180b16efd4dfde1b4/users/216772204be1430597b0fb9488638386/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:39.008232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f32b-67f6-4438-a0cb-7f32cd4f1550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaac9b187b70474180b16efd4dfde1b4, user_id=216772204be1430597b0fb9488638386, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:39.018697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f32b-67f6-4438-a0cb-7f32cd4f1550 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:39.059576 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 848/1696] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:38 2022] PUT /identity/v3/projects/aaac9b187b70474180b16efd4dfde1b4/users/216772204be1430597b0fb9488638386/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:39.062094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f901e-93fd-4bb7-b53f-15f0ba0d6ac3 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:39.062094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f901e-93fd-4bb7-b53f-15f0ba0d6ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:39.062265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f901e-93fd-4bb7-b53f-15f0ba0d6ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:39.130108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a583eb-0d85-4a62-ac32-d4bac6bcd842 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:39.165903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-712f901e-93fd-4bb7-b53f-15f0ba0d6ac3 None None] MFA Rules not processed for user `e01fd82a1ff44587b45f72f82e1562a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:39.165903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-712f901e-93fd-4bb7-b53f-15f0ba0d6ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:39.249273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5191059-bf58-4c0c-b32f-730b41b8c468 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:39.250392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5191059-bf58-4c0c-b32f-730b41b8c468 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:39.252144 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5191059-bf58-4c0c-b32f-730b41b8c468 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:39.253189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5191059-bf58-4c0c-b32f-730b41b8c468 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:39.278701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5191059-bf58-4c0c-b32f-730b41b8c468 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:39.281169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5191059-bf58-4c0c-b32f-730b41b8c468 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:39.313479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 849/1697] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:39.313662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 849/1698] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:39.313662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5191059-bf58-4c0c-b32f-730b41b8c468 service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:39.313790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d837c-7c0d-4f9f-ad03-1df7420cff52 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:39.313790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d837c-7c0d-4f9f-ad03-1df7420cff52 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:39.322272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d837c-7c0d-4f9f-ad03-1df7420cff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:39.418825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-035d837c-7c0d-4f9f-ad03-1df7420cff52 None None] MFA Rules not processed for user `216772204be1430597b0fb9488638386`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:39.422636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-035d837c-7c0d-4f9f-ad03-1df7420cff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:39.427651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:39.470293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5191059-bf58-4c0c-b32f-730b41b8c468 service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:39.479778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624654-d030-4be9-9cf4-27a084be2ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:39.480423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624654-d030-4be9-9cf4-27a084be2ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:39.480728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624654-d030-4be9-9cf4-27a084be2ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:39.481229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624654-d030-4be9-9cf4-27a084be2ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:39.624403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624654-d030-4be9-9cf4-27a084be2ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:39.625968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624654-d030-4be9-9cf4-27a084be2ce3 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:39.630127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 850/1699] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:39.631239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d837c-7c0d-4f9f-ad03-1df7420cff52 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:39.635660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-035d837c-7c0d-4f9f-ad03-1df7420cff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:39.660175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 850/1700] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:39.668931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624654-d030-4be9-9cf4-27a084be2ce3 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:39.679420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6a624654-d030-4be9-9cf4-27a084be2ce3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:39.718228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624654-d030-4be9-9cf4-27a084be2ce3 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:39.729473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13304f-69af-4936-80d4-bb0c256712a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:39.730115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13304f-69af-4936-80d4-bb0c256712a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:39.730398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13304f-69af-4936-80d4-bb0c256712a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:39.731002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13304f-69af-4936-80d4-bb0c256712a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:39.753661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13304f-69af-4936-80d4-bb0c256712a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:39.756040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13304f-69af-4936-80d4-bb0c256712a4 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:39.779053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 851/1701] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:39.854541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d837c-7c0d-4f9f-ad03-1df7420cff52 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:39.887208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb84da-260f-4cef-a321-5e292a3eac88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:39.887890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb84da-260f-4cef-a321-5e292a3eac88 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:39.891446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb84da-260f-4cef-a321-5e292a3eac88 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:39.891751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb84da-260f-4cef-a321-5e292a3eac88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:39.919134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb84da-260f-4cef-a321-5e292a3eac88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:39.921224 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb84da-260f-4cef-a321-5e292a3eac88 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:39.940441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 851/1702] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:40.126703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ee9eb-c2eb-4e53-a071-2f90f1db3bfc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:40.127135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ee9eb-c2eb-4e53-a071-2f90f1db3bfc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:40.127423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ee9eb-c2eb-4e53-a071-2f90f1db3bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:40.206653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a96ee9eb-c2eb-4e53-a071-2f90f1db3bfc None None] MFA Rules not processed for user `447e163734594f7a8bce9504984b02e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:40.211739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a96ee9eb-c2eb-4e53-a071-2f90f1db3bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:40.306980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:40.387038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 852/1703] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:40.400440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053877a-7ce6-4528-bdb8-fc22f5167f27 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:40.400725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053877a-7ce6-4528-bdb8-fc22f5167f27 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:40.401047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053877a-7ce6-4528-bdb8-fc22f5167f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:40.454155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-4053877a-7ce6-4528-bdb8-fc22f5167f27 None None] MFA Rules not processed for user `447e163734594f7a8bce9504984b02e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:40.455867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4053877a-7ce6-4528-bdb8-fc22f5167f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:40.467415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 852/1704] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:40.479440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ee9eb-c2eb-4e53-a071-2f90f1db3bfc None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:40.481008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a96ee9eb-c2eb-4e53-a071-2f90f1db3bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:40.520445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ee9eb-c2eb-4e53-a071-2f90f1db3bfc None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:40.535875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ad7b-2350-485f-b884-85aac1afdbbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:40.538200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ad7b-2350-485f-b884-85aac1afdbbb service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:40.538549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ad7b-2350-485f-b884-85aac1afdbbb service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:40.538833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ad7b-2350-485f-b884-85aac1afdbbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:40.560099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ad7b-2350-485f-b884-85aac1afdbbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:40.561870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ad7b-2350-485f-b884-85aac1afdbbb service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:40.566207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053877a-7ce6-4528-bdb8-fc22f5167f27 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:40.568099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4053877a-7ce6-4528-bdb8-fc22f5167f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:40.576369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 853/1705] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:40.742677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053877a-7ce6-4528-bdb8-fc22f5167f27 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:40.756052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:40.757325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:40.757638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:40.759086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] PATH_INFO: `/v3/users/a9a9b044d2c54c3b8e6350f1f7443d3f` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:40.761054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a9b044d2c54c3b8e6350f1f7443d3f)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:40.765382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:41.043054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:41.166524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a9b044d2c54c3b8e6350f1f7443d3f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:41.173356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a9b044d2c54c3b8e6350f1f7443d3f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:41.233016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4333f-3e1a-40c7-9b63-43a2da30e85f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:41.233308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4333f-3e1a-40c7-9b63-43a2da30e85f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:41.233970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4333f-3e1a-40c7-9b63-43a2da30e85f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:41.236539 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 854/1706] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:08:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:08:41.277242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a9b044d2c54c3b8e6350f1f7443d3f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:41.277958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a9b044d2c54c3b8e6350f1f7443d3f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:41.300894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ee587251-873d-4d77-865e-0c8ecf0fd034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a9b044d2c54c3b8e6350f1f7443d3f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:41.349682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 853/1707] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:08:40 2022] DELETE /identity/v3/users/a9a9b044d2c54c3b8e6350f1f7443d3f => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:41.350765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41591dc-7eec-4110-808c-680017cced8f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:41.351213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41591dc-7eec-4110-808c-680017cced8f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:41.351646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41591dc-7eec-4110-808c-680017cced8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:41.389352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c41591dc-7eec-4110-808c-680017cced8f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:41.392807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c41591dc-7eec-4110-808c-680017cced8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:41.511535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfd1e7-9709-4ccd-8e84-f6cf2f7feb8b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:41.512007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfd1e7-9709-4ccd-8e84-f6cf2f7feb8b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:41.512175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfd1e7-9709-4ccd-8e84-f6cf2f7feb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:41.536399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 855/1708] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:41.546262 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9ebfd1e7-9709-4ccd-8e84-f6cf2f7feb8b None None] MFA Rules not processed for user `4dded05b23a0469785e3a7bedf1cf851`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:41.547616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9ebfd1e7-9709-4ccd-8e84-f6cf2f7feb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:41.610012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41591dc-7eec-4110-808c-680017cced8f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:41.611953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c41591dc-7eec-4110-808c-680017cced8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:41.768154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41591dc-7eec-4110-808c-680017cced8f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:41.777004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eea335-b547-4e36-a9c5-ad4d93647bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:41.778422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 854/1709] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:08:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:41.778742 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eea335-b547-4e36-a9c5-ad4d93647bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:41.779238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eea335-b547-4e36-a9c5-ad4d93647bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:41.779708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eea335-b547-4e36-a9c5-ad4d93647bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:41.800167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eea335-b547-4e36-a9c5-ad4d93647bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:41.802649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eea335-b547-4e36-a9c5-ad4d93647bf8 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:41.824485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 856/1710] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:41.885799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfd1e7-9709-4ccd-8e84-f6cf2f7feb8b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:41.890045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9ebfd1e7-9709-4ccd-8e84-f6cf2f7feb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:41.894423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:41.901619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eea335-b547-4e36-a9c5-ad4d93647bf8 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:41.903595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-06eea335-b547-4e36-a9c5-ad4d93647bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:41.948205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfd1e7-9709-4ccd-8e84-f6cf2f7feb8b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:41.961366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:41.962295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:41.962751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:41.970781 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] PATH_INFO: `/v3/users/efe43f98c4404fe6a28bb2c0efd28b61` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:41.973110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe43f98c4404fe6a28bb2c0efd28b61)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:41.977375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eea335-b547-4e36-a9c5-ad4d93647bf8 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:41.980638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:41.991694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2989cbd-bffa-494f-b479-629e2d5c4be6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:41.994284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2989cbd-bffa-494f-b479-629e2d5c4be6 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:41.994854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2989cbd-bffa-494f-b479-629e2d5c4be6 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:41.995654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2989cbd-bffa-494f-b479-629e2d5c4be6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:42.012204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2989cbd-bffa-494f-b479-629e2d5c4be6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:42.015070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2989cbd-bffa-494f-b479-629e2d5c4be6 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:42.033236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 857/1711] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:42.035118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2989cbd-bffa-494f-b479-629e2d5c4be6 service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:42.038443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a2989cbd-bffa-494f-b479-629e2d5c4be6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:42.155358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2989cbd-bffa-494f-b479-629e2d5c4be6 service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:42.166159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923149d9-fc27-4554-9d8d-107efb15f511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:42.166807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923149d9-fc27-4554-9d8d-107efb15f511 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:42.167086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923149d9-fc27-4554-9d8d-107efb15f511 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:42.167504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923149d9-fc27-4554-9d8d-107efb15f511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:42.171555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-923149d9-fc27-4554-9d8d-107efb15f511 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:42.295191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe43f98c4404fe6a28bb2c0efd28b61'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:42.297807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe43f98c4404fe6a28bb2c0efd28b61'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:42.361073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923149d9-fc27-4554-9d8d-107efb15f511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:42.362795 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923149d9-fc27-4554-9d8d-107efb15f511 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:42.386188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 858/1712] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:42.398128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01a461-c280-4b7a-baf3-a6c2084fac4f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:42.398128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01a461-c280-4b7a-baf3-a6c2084fac4f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:42.398128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01a461-c280-4b7a-baf3-a6c2084fac4f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:42.398128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 859/1713] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 28 18:08:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:08:42.405038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad71877-2878-492d-bed9-ea3b9c53933e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:42.405570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad71877-2878-492d-bed9-ea3b9c53933e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:42.406069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad71877-2878-492d-bed9-ea3b9c53933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:42.442966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe43f98c4404fe6a28bb2c0efd28b61'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:42.444483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe43f98c4404fe6a28bb2c0efd28b61'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:42.489020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe43f98c4404fe6a28bb2c0efd28b61'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:42.544437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 855/1714] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:08:41 2022] DELETE /identity/v3/users/efe43f98c4404fe6a28bb2c0efd28b61 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:42.557077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2ad71877-2878-492d-bed9-ea3b9c53933e None None] MFA Rules not processed for user `0116171a83f5444d91ce0ea2439a9bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:42.569600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2ad71877-2878-492d-bed9-ea3b9c53933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:42.694407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 860/1715] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:08:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:42.781153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:42.783559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:42.808413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf03f3d-c6ec-4e38-859c-30766cc3ea82 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:42.819418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b71f56-fb7e-4bf7-b590-690d554b9196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:42.821544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b71f56-fb7e-4bf7-b590-690d554b9196 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:42.823767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b71f56-fb7e-4bf7-b590-690d554b9196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:42.824268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b71f56-fb7e-4bf7-b590-690d554b9196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:42.847211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b71f56-fb7e-4bf7-b590-690d554b9196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:42.852389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b71f56-fb7e-4bf7-b590-690d554b9196 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:42.877088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 856/1716] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:43.135098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:43.174247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:43.857711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad71877-2878-492d-bed9-ea3b9c53933e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:43.859218 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2ad71877-2878-492d-bed9-ea3b9c53933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:43.979855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad71877-2878-492d-bed9-ea3b9c53933e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:43.992307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:43.993308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:43.993820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:43.994295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] PATH_INFO: `/v3/projects/1b1a62abbf574258bee7fcbd108da1e0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:43.997944 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1a62abbf574258bee7fcbd108da1e0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:44.001432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:44.057465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b71f56-fb7e-4bf7-b590-690d554b9196 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:44.060277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-81b71f56-fb7e-4bf7-b590-690d554b9196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:44.108007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b71f56-fb7e-4bf7-b590-690d554b9196 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:44.124974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:44.125948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:44.126429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:44.126901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] PATH_INFO: `/v3/projects/d1bb557089e14bfb989875b52bd6433a` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:44.128525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1bb557089e14bfb989875b52bd6433a)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:44.150186 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:44.207179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1a62abbf574258bee7fcbd108da1e0', 'request_id': 'req-47d78096-3ee1-4a95-9fe2-4547d6078bf7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.619015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1a62abbf574258bee7fcbd108da1e0', 'request_id': 'req-47d78096-3ee1-4a95-9fe2-4547d6078bf7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.628073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1a62abbf574258bee7fcbd108da1e0', 'request_id': 'req-47d78096-3ee1-4a95-9fe2-4547d6078bf7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.649373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1bb557089e14bfb989875b52bd6433a', 'request_id': 'req-aa7fced8-dd96-4fea-9e11-b70d7e07063e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.653648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] The token cache is being invalidate because project 1b1a62abbf574258bee7fcbd108da1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:08:44.653989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.655175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.657559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 861/1717] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:08:43 2022] DELETE /identity/v3/projects/1b1a62abbf574258bee7fcbd108da1e0 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:44.658719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:44.659541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1bb557089e14bfb989875b52bd6433a', 'request_id': 'req-aa7fced8-dd96-4fea-9e11-b70d7e07063e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.662092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:44.764514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1bb557089e14bfb989875b52bd6433a', 'request_id': 'req-aa7fced8-dd96-4fea-9e11-b70d7e07063e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.766472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d78096-3ee1-4a95-9fe2-4547d6078bf7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:44.790790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] The token cache is being invalidate because project d1bb557089e14bfb989875b52bd6433a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:08:44.803443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.803443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:44.803443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 857/1718] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:08:44 2022] DELETE /identity/v3/projects/d1bb557089e14bfb989875b52bd6433a => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:44.803443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:44.803443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:44.940366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:44.942930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fced8-dd96-4fea-9e11-b70d7e07063e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:44.948959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:44.950284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:44.950787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:44.951334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] PATH_INFO: `/v3/users/73b33ff38f4d4b0cb2ab9194dce59a96` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:44.953032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b33ff38f4d4b0cb2ab9194dce59a96)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:44.955903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:44.977582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410af3c9-aecd-4787-8d78-060fe144d21d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:44.978854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410af3c9-aecd-4787-8d78-060fe144d21d service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:44.978854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410af3c9-aecd-4787-8d78-060fe144d21d service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:44.978854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410af3c9-aecd-4787-8d78-060fe144d21d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:44.981010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-410af3c9-aecd-4787-8d78-060fe144d21d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:45.003777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410af3c9-aecd-4787-8d78-060fe144d21d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:45.006619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410af3c9-aecd-4787-8d78-060fe144d21d service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:45.027273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 862/1719] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:45.029841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f002c31-03c5-450d-af4e-b673b7112c01 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:45.030453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f002c31-03c5-450d-af4e-b673b7112c01 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:45.030894 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f002c31-03c5-450d-af4e-b673b7112c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:45.060957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4f002c31-03c5-450d-af4e-b673b7112c01 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:45.062803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4f002c31-03c5-450d-af4e-b673b7112c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:45.085066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 863/1720] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:45.096775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441b9e-17f5-4f49-b6e9-a3a83236c328 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:45.097100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441b9e-17f5-4f49-b6e9-a3a83236c328 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:45.097624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441b9e-17f5-4f49-b6e9-a3a83236c328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:45.162708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-32441b9e-17f5-4f49-b6e9-a3a83236c328 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:45.166045 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-32441b9e-17f5-4f49-b6e9-a3a83236c328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:45.200889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 864/1721] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:45.206328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441b9e-17f5-4f49-b6e9-a3a83236c328 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:45.237292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441b9e-17f5-4f49-b6e9-a3a83236c328 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:45.252607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c503aae-e3e4-497c-b275-e396622ff047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:45.255740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c503aae-e3e4-497c-b275-e396622ff047 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:45.255877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c503aae-e3e4-497c-b275-e396622ff047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:45.258737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c503aae-e3e4-497c-b275-e396622ff047 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:45.260855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c503aae-e3e4-497c-b275-e396622ff047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:45.264476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c503aae-e3e4-497c-b275-e396622ff047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:45.270172 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c503aae-e3e4-497c-b275-e396622ff047 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:45.296233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b33ff38f4d4b0cb2ab9194dce59a96'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:45.296233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b33ff38f4d4b0cb2ab9194dce59a96'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:45.336012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 865/1722] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:08:45.340551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c503aae-e3e4-497c-b275-e396622ff047 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:45.367197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c503aae-e3e4-497c-b275-e396622ff047 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:45.396934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698560d6-d79b-48bc-9a55-4c88d251e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:45.399639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698560d6-d79b-48bc-9a55-4c88d251e3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:45.399639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698560d6-d79b-48bc-9a55-4c88d251e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:45.399639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698560d6-d79b-48bc-9a55-4c88d251e3a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:45.399639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698560d6-d79b-48bc-9a55-4c88d251e3a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:45.403452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698560d6-d79b-48bc-9a55-4c88d251e3a5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:45.459884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b33ff38f4d4b0cb2ab9194dce59a96'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:45.462787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b33ff38f4d4b0cb2ab9194dce59a96'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:45.495614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b33ff38f4d4b0cb2ab9194dce59a96'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:45.586939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 858/1723] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:08:44 2022] DELETE /identity/v3/users/73b33ff38f4d4b0cb2ab9194dce59a96 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:45.630367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 866/1724] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:45 2022] POST /identity/v3/projects => generated 379 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:08:45.634088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:45.636390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:45.901327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ec6e1-681f-434b-bf8a-89eddaa86b66 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:46.096485 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c146a5-38fd-42ea-900e-09b5b8cd5825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:46.097771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c146a5-38fd-42ea-900e-09b5b8cd5825 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:46.098299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c146a5-38fd-42ea-900e-09b5b8cd5825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:46.098934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c146a5-38fd-42ea-900e-09b5b8cd5825 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:46.099990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c146a5-38fd-42ea-900e-09b5b8cd5825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:46.104645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c146a5-38fd-42ea-900e-09b5b8cd5825 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:46.216082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:46.228964 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 859/1725] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:45 2022] POST /identity/v3/users => generated 290 bytes in 593 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:46.230240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698560d6-d79b-48bc-9a55-4c88d251e3a5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:46.250900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698560d6-d79b-48bc-9a55-4c88d251e3a5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:46.257262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8a9ba-b124-490e-968e-00bed56cdf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:46.258267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8a9ba-b124-490e-968e-00bed56cdf2f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:46.258929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8a9ba-b124-490e-968e-00bed56cdf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:46.259420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8a9ba-b124-490e-968e-00bed56cdf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:46.260387 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8a9ba-b124-490e-968e-00bed56cdf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:46.262665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8a9ba-b124-490e-968e-00bed56cdf2f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:46.276398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 867/1726] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:46.283301 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c146a5-38fd-42ea-900e-09b5b8cd5825 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:46.292801 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c146a5-38fd-42ea-900e-09b5b8cd5825 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:46.299164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f0445-ac12-42ef-8a52-756862d0924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:46.300643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f0445-ac12-42ef-8a52-756862d0924e admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:46.301161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f0445-ac12-42ef-8a52-756862d0924e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:46.301982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f0445-ac12-42ef-8a52-756862d0924e admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:46.304875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f0445-ac12-42ef-8a52-756862d0924e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:46.306433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:46.308181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f0445-ac12-42ef-8a52-756862d0924e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:46.321721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 860/1727] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:08:46.333495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8a9ba-b124-490e-968e-00bed56cdf2f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:46.351850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8a9ba-b124-490e-968e-00bed56cdf2f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:46.365290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cd4e6-8fc8-4369-82aa-2a586d26278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:46.370808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cd4e6-8fc8-4369-82aa-2a586d26278b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:46.371111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cd4e6-8fc8-4369-82aa-2a586d26278b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:46.376141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cd4e6-8fc8-4369-82aa-2a586d26278b admin admin] PATH_INFO: `/v3/projects/d0a4df3a9a424eb89a241f69902f5d9c/users/0503c896d6eb4f8da3b2fc8f248a73e4/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:46.437639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cd4e6-8fc8-4369-82aa-2a586d26278b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a4df3a9a424eb89a241f69902f5d9c, user_id=0503c896d6eb4f8da3b2fc8f248a73e4, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:46.445512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cd4e6-8fc8-4369-82aa-2a586d26278b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:46.482531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8e99a-ed6a-41ce-b847-dd68a1707cbb None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:46.482531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8e99a-ed6a-41ce-b847-dd68a1707cbb None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:46.482531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8e99a-ed6a-41ce-b847-dd68a1707cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:46.551587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-59a8e99a-ed6a-41ce-b847-dd68a1707cbb None None] MFA Rules not processed for user `7388d3603bbd428cabf62a1f46e73929`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:46.552893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-59a8e99a-ed6a-41ce-b847-dd68a1707cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:46.574679 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 868/1728] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:46 2022] PUT /identity/v3/projects/d0a4df3a9a424eb89a241f69902f5d9c/users/0503c896d6eb4f8da3b2fc8f248a73e4/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:46.576818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380e9e-1571-4fc5-99fd-3c691de7d93e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:46.577096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380e9e-1571-4fc5-99fd-3c691de7d93e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:46.577375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380e9e-1571-4fc5-99fd-3c691de7d93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:46.659054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-43380e9e-1571-4fc5-99fd-3c691de7d93e None None] MFA Rules not processed for user `9b585090272c4b4ab7d1937ebc9fa649`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:46.660374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-43380e9e-1571-4fc5-99fd-3c691de7d93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:46.720569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 861/1729] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:46.733774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8e99a-ed6a-41ce-b847-dd68a1707cbb None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:46.738887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-59a8e99a-ed6a-41ce-b847-dd68a1707cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:46.774004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8e99a-ed6a-41ce-b847-dd68a1707cbb None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:46.863592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 869/1730] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:46.865119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b62689-7f26-4d4e-b289-8e0dddd6d2d5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:46.865407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b62689-7f26-4d4e-b289-8e0dddd6d2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:46.865753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b62689-7f26-4d4e-b289-8e0dddd6d2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:46.937366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:46.942159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:46.946643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:46.946643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] PATH_INFO: `/v3/projects/bbcf47712066406ab1f9acf5874fc65e` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:46.948627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcf47712066406ab1f9acf5874fc65e)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:46.956870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:46.975565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-68b62689-7f26-4d4e-b289-8e0dddd6d2d5 None None] MFA Rules not processed for user `0503c896d6eb4f8da3b2fc8f248a73e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:46.978932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-68b62689-7f26-4d4e-b289-8e0dddd6d2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:47.183686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 870/1731] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:47.184899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b62689-7f26-4d4e-b289-8e0dddd6d2d5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:47.186450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-68b62689-7f26-4d4e-b289-8e0dddd6d2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:47.236207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcf47712066406ab1f9acf5874fc65e', 'request_id': 'req-a80beed8-b44b-49c6-a89d-82e4b03ade68'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:47.258450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcf47712066406ab1f9acf5874fc65e', 'request_id': 'req-a80beed8-b44b-49c6-a89d-82e4b03ade68'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:47.322555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b62689-7f26-4d4e-b289-8e0dddd6d2d5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:47.351585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcf47712066406ab1f9acf5874fc65e', 'request_id': 'req-a80beed8-b44b-49c6-a89d-82e4b03ade68'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:47.365035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] The token cache is being invalidate because project bbcf47712066406ab1f9acf5874fc65e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:08:47.367072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:47.367072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:47.368675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 862/1732] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:08:46 2022] DELETE /identity/v3/projects/bbcf47712066406ab1f9acf5874fc65e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:47.369644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:47.372841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:47.467605 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:47.468171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:47.468450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:47.468722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:47.471536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:47.528259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80beed8-b44b-49c6-a89d-82e4b03ade68 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:47.548099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03b3d-43ce-45b1-a308-ac4c3a896a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:47.548753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03b3d-43ce-45b1-a308-ac4c3a896a50 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:47.549073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03b3d-43ce-45b1-a308-ac4c3a896a50 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:47.549345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03b3d-43ce-45b1-a308-ac4c3a896a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:47.557281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-dfe03b3d-43ce-45b1-a308-ac4c3a896a50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:47.607977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:47.609630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:47.634060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 871/1733] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:47.634912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:47.642130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:47.655688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:47.713606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03b3d-43ce-45b1-a308-ac4c3a896a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:47.715218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03b3d-43ce-45b1-a308-ac4c3a896a50 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:47.734280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 863/1734] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:47.737443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53f90d-4611-4e8b-b977-e34ee7a65433 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:47.738146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53f90d-4611-4e8b-b977-e34ee7a65433 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:47.738146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53f90d-4611-4e8b-b977-e34ee7a65433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:47.776315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-3a53f90d-4611-4e8b-b977-e34ee7a65433 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:47.776315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-3a53f90d-4611-4e8b-b977-e34ee7a65433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:47.943831 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727bfd1-41de-4b6d-916b-1d3ae17810e9 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:47.974109 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e1a72-2b5d-4054-9187-8b59db76b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:47.976177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e1a72-2b5d-4054-9187-8b59db76b727 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:47.976465 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e1a72-2b5d-4054-9187-8b59db76b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:47.976739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e1a72-2b5d-4054-9187-8b59db76b727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:47.987985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 864/1735] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:47.988349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e1a72-2b5d-4054-9187-8b59db76b727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:48.005954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ce985-c4ac-49b2-b586-372ed82942f3 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:48.005954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ce985-c4ac-49b2-b586-372ed82942f3 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:48.005954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ce985-c4ac-49b2-b586-372ed82942f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:48.016423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e1a72-2b5d-4054-9187-8b59db76b727 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:48.060253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-888ce985-c4ac-49b2-b586-372ed82942f3 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:48.061495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-888ce985-c4ac-49b2-b586-372ed82942f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:48.105832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 865/1736] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:48.108314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ce985-c4ac-49b2-b586-372ed82942f3 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:48.140312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ce985-c4ac-49b2-b586-372ed82942f3 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:48.144454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543480a-211d-4373-b06d-03d5bccd2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:48.145325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543480a-211d-4373-b06d-03d5bccd2258 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:48.145753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543480a-211d-4373-b06d-03d5bccd2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:48.146161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543480a-211d-4373-b06d-03d5bccd2258 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:48.147084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543480a-211d-4373-b06d-03d5bccd2258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:08:48.147525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543480a-211d-4373-b06d-03d5bccd2258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:48.149300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543480a-211d-4373-b06d-03d5bccd2258 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:48.180411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 866/1737] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:08:48.185047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543480a-211d-4373-b06d-03d5bccd2258 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:48.197667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543480a-211d-4373-b06d-03d5bccd2258 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:48.202094 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 872/1738] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:47 2022] POST /identity/v3/projects => generated 379 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:48.206631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e1a72-2b5d-4054-9187-8b59db76b727 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:48.351524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a31a4-2506-47a2-b772-8238b70de6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:48.352741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a31a4-2506-47a2-b772-8238b70de6dc admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:48.356768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a31a4-2506-47a2-b772-8238b70de6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:48.357280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a31a4-2506-47a2-b772-8238b70de6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:48.359350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a31a4-2506-47a2-b772-8238b70de6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:48.365671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a31a4-2506-47a2-b772-8238b70de6dc admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:48.452357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e1a72-2b5d-4054-9187-8b59db76b727 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:48.457703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205aa1-58de-4052-861f-18fa4c74b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:48.458528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205aa1-58de-4052-861f-18fa4c74b17a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:48.459281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205aa1-58de-4052-861f-18fa4c74b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:48.460030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205aa1-58de-4052-861f-18fa4c74b17a admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:48.465614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a205aa1-58de-4052-861f-18fa4c74b17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:48.468379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a205aa1-58de-4052-861f-18fa4c74b17a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:48.547841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 867/1739] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:48 2022] POST /identity/v3/projects => generated 361 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:08:48.552413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a31a4-2506-47a2-b772-8238b70de6dc admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:48.643627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 873/1740] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:48 2022] POST /identity/v3/users => generated 296 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:48.648085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205aa1-58de-4052-861f-18fa4c74b17a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:48.660056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a31a4-2506-47a2-b772-8238b70de6dc admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:48.678279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badca15b-3648-4e16-99c2-90b7808e3cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:48.679872 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badca15b-3648-4e16-99c2-90b7808e3cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:48.682716 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badca15b-3648-4e16-99c2-90b7808e3cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:48.683070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badca15b-3648-4e16-99c2-90b7808e3cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:48.683788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badca15b-3648-4e16-99c2-90b7808e3cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:48.687597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205aa1-58de-4052-861f-18fa4c74b17a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:48.690933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badca15b-3648-4e16-99c2-90b7808e3cf3 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:48.709637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0b282-cbaa-405b-b3fd-2f3b722ab9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:48.710460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0b282-cbaa-405b-b3fd-2f3b722ab9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:48.711003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0b282-cbaa-405b-b3fd-2f3b722ab9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:48.711282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0b282-cbaa-405b-b3fd-2f3b722ab9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:48.712006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0b282-cbaa-405b-b3fd-2f3b722ab9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:48.716430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0b282-cbaa-405b-b3fd-2f3b722ab9c1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:48.755654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 874/1741] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:08:48.758195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0b282-cbaa-405b-b3fd-2f3b722ab9c1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:48.782876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0b282-cbaa-405b-b3fd-2f3b722ab9c1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:48.833559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e36e8d-c158-4588-8f4d-de44969af344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:48.834888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e36e8d-c158-4588-8f4d-de44969af344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:48.835472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e36e8d-c158-4588-8f4d-de44969af344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:48.839307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e36e8d-c158-4588-8f4d-de44969af344 admin admin] PATH_INFO: `/v3/projects/25b0b90baf254474852ab684145aa523/users/d9f810ac68f54ddca4692c533fc791b4/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:48.853308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 868/1742] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:48 2022] POST /identity/v3/users => generated 281 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:08:48.856710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badca15b-3648-4e16-99c2-90b7808e3cf3 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:48.885656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badca15b-3648-4e16-99c2-90b7808e3cf3 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:48.891025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e36e8d-c158-4588-8f4d-de44969af344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b0b90baf254474852ab684145aa523, user_id=d9f810ac68f54ddca4692c533fc791b4, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:48.894524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e36e8d-c158-4588-8f4d-de44969af344 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:48.918418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6c064-d645-44f9-a625-d69de148d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:48.919120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c064-d645-44f9-a625-d69de148d78c admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:48.919389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c064-d645-44f9-a625-d69de148d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:48.919722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c064-d645-44f9-a625-d69de148d78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:48.921602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6c064-d645-44f9-a625-d69de148d78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:48.923251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6c064-d645-44f9-a625-d69de148d78c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:48.940827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 869/1743] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:48.944682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6c064-d645-44f9-a625-d69de148d78c admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:48.956139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6c064-d645-44f9-a625-d69de148d78c admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:48.981695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:48.983140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c363b-2aad-4f08-b667-cb3fe9c50021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:48.984085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c363b-2aad-4f08-b667-cb3fe9c50021 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:48.984578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c363b-2aad-4f08-b667-cb3fe9c50021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:48.985059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c363b-2aad-4f08-b667-cb3fe9c50021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:48.986042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c363b-2aad-4f08-b667-cb3fe9c50021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:48.988067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c363b-2aad-4f08-b667-cb3fe9c50021 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:49.016465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 870/1744] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:08:49.026523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c363b-2aad-4f08-b667-cb3fe9c50021 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:49.028900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 875/1745] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:48 2022] PUT /identity/v3/projects/25b0b90baf254474852ab684145aa523/users/d9f810ac68f54ddca4692c533fc791b4/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:49.033246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e36e8d-c158-4588-8f4d-de44969af344 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:49.065025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c363b-2aad-4f08-b667-cb3fe9c50021 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:49.167112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdd335-abac-451f-9d21-c9da242220f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:49.167958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdd335-abac-451f-9d21-c9da242220f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:49.168368 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdd335-abac-451f-9d21-c9da242220f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:49.168940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdd335-abac-451f-9d21-c9da242220f0 admin admin] PATH_INFO: `/v3/projects/b8e85e13be674543a54f5e4df2887abe/users/064c5fe9f43e471ca1c6a10c20b48422/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:49.182736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e36e8d-c158-4588-8f4d-de44969af344 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:49.190436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a6666-e41d-4bc6-9bdf-4093e290b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:49.191495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a6666-e41d-4bc6-9bdf-4093e290b1df admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:49.191928 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a6666-e41d-4bc6-9bdf-4093e290b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:49.192384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a6666-e41d-4bc6-9bdf-4093e290b1df admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:49.193314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a6666-e41d-4bc6-9bdf-4093e290b1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:49.196206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a6666-e41d-4bc6-9bdf-4093e290b1df admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:49.204962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdd335-abac-451f-9d21-c9da242220f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e85e13be674543a54f5e4df2887abe, user_id=064c5fe9f43e471ca1c6a10c20b48422, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:49.219340 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdd335-abac-451f-9d21-c9da242220f0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:49.219692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 876/1746] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:49.219692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b47688-2cf0-438b-9730-f9afaf3f666e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:49.219692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b47688-2cf0-438b-9730-f9afaf3f666e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:49.219692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b47688-2cf0-438b-9730-f9afaf3f666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:49.239702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a7b47688-2cf0-438b-9730-f9afaf3f666e None None] MFA Rules not processed for user `e01fd82a1ff44587b45f72f82e1562a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:49.253447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a7b47688-2cf0-438b-9730-f9afaf3f666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:49.329056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 877/1747] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:49.330953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b47688-2cf0-438b-9730-f9afaf3f666e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:49.346481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 871/1748] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:49 2022] PUT /identity/v3/projects/b8e85e13be674543a54f5e4df2887abe/users/064c5fe9f43e471ca1c6a10c20b48422/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:49.357158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cfac8-e940-4909-a971-02d26c8d04a2 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:49.358375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cfac8-e940-4909-a971-02d26c8d04a2 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:49.358375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cfac8-e940-4909-a971-02d26c8d04a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:49.375245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b47688-2cf0-438b-9730-f9afaf3f666e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:49.435149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-793cfac8-e940-4909-a971-02d26c8d04a2 None None] MFA Rules not processed for user `064c5fe9f43e471ca1c6a10c20b48422`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:49.445755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-793cfac8-e940-4909-a971-02d26c8d04a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:49.493126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e93b7-0d32-4a27-9a0d-25f20a85ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:49.494369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e93b7-0d32-4a27-9a0d-25f20a85ead7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:49.502662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e93b7-0d32-4a27-9a0d-25f20a85ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:49.502662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e93b7-0d32-4a27-9a0d-25f20a85ead7 admin admin] PATH_INFO: `/v3/projects/25b0b90baf254474852ab684145aa523/users/d9f810ac68f54ddca4692c533fc791b4/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:49.505894 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e93b7-0d32-4a27-9a0d-25f20a85ead7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b0b90baf254474852ab684145aa523, user_id=d9f810ac68f54ddca4692c533fc791b4, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:49.509611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e93b7-0d32-4a27-9a0d-25f20a85ead7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:49.546570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 878/1749] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:49 2022] PUT /identity/v3/projects/25b0b90baf254474852ab684145aa523/users/d9f810ac68f54ddca4692c533fc791b4/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:49.559321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19f767-bd56-4005-b14d-682f5ea7ec02 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:49.563407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19f767-bd56-4005-b14d-682f5ea7ec02 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:49.564023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19f767-bd56-4005-b14d-682f5ea7ec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:49.573437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 872/1750] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:49.581186 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cfac8-e940-4909-a971-02d26c8d04a2 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:49.612365 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cfac8-e940-4909-a971-02d26c8d04a2 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:49.635936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8f19f767-bd56-4005-b14d-682f5ea7ec02 None None] MFA Rules not processed for user `d9f810ac68f54ddca4692c533fc791b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:49.637208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8f19f767-bd56-4005-b14d-682f5ea7ec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:49.868100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd06a4-e14d-4041-89d0-53ec2d7c32f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:49.868751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd06a4-e14d-4041-89d0-53ec2d7c32f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:49.869126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd06a4-e14d-4041-89d0-53ec2d7c32f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:49.869402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd06a4-e14d-4041-89d0-53ec2d7c32f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:49.870083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd06a4-e14d-4041-89d0-53ec2d7c32f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:49.893119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd06a4-e14d-4041-89d0-53ec2d7c32f8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:49.920079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 879/1751] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:49.940570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19f767-bd56-4005-b14d-682f5ea7ec02 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:49.945256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8f19f767-bd56-4005-b14d-682f5ea7ec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:50.054289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 873/1752] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:08:49 2022] POST /identity/v3/projects => generated 365 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:50.058924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd06a4-e14d-4041-89d0-53ec2d7c32f8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:50.138754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19f767-bd56-4005-b14d-682f5ea7ec02 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:50.258974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d080-3e42-4f81-908e-007b302f5ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:50.258974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d080-3e42-4f81-908e-007b302f5ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:50.258974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d080-3e42-4f81-908e-007b302f5ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:50.258974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d080-3e42-4f81-908e-007b302f5ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:50.264830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-22a5d080-3e42-4f81-908e-007b302f5ff5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:50.278653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd06a4-e14d-4041-89d0-53ec2d7c32f8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:50.289079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876fdd8-6200-4dca-9dce-75559f87003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:50.289786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876fdd8-6200-4dca-9dce-75559f87003d admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:50.290078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876fdd8-6200-4dca-9dce-75559f87003d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:50.290353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876fdd8-6200-4dca-9dce-75559f87003d admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:50.291332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876fdd8-6200-4dca-9dce-75559f87003d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:50.300469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876fdd8-6200-4dca-9dce-75559f87003d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:50.417012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 874/1753] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:08:50 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:08:50.420840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876fdd8-6200-4dca-9dce-75559f87003d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:50.440157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876fdd8-6200-4dca-9dce-75559f87003d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:50.447578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c99a3-d34b-4316-9006-945195351192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:50.448614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c99a3-d34b-4316-9006-945195351192 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:50.449146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c99a3-d34b-4316-9006-945195351192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:50.465853 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c99a3-d34b-4316-9006-945195351192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:50.467116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c99a3-d34b-4316-9006-945195351192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:50.471411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c99a3-d34b-4316-9006-945195351192 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:50.491730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 875/1754] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:50.496110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c99a3-d34b-4316-9006-945195351192 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:50.535378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c99a3-d34b-4316-9006-945195351192 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:50.541780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ded15-a918-44af-a6c4-044725f88a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:50.542741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ded15-a918-44af-a6c4-044725f88a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:50.543176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ded15-a918-44af-a6c4-044725f88a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:50.543769 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ded15-a918-44af-a6c4-044725f88a0b admin admin] PATH_INFO: `/v3/projects/68f3a4cca93740f4a88aca32ec16ed1b/users/f3af17559af04b71bfeb4178ee841514/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:50.573214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d080-3e42-4f81-908e-007b302f5ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:50.574692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d080-3e42-4f81-908e-007b302f5ff5 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:50.586669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ded15-a918-44af-a6c4-044725f88a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f3a4cca93740f4a88aca32ec16ed1b, user_id=f3af17559af04b71bfeb4178ee841514, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:50.590361 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ded15-a918-44af-a6c4-044725f88a0b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:50.609165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 880/1755] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:50.713267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 876/1756] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:50 2022] PUT /identity/v3/projects/68f3a4cca93740f4a88aca32ec16ed1b/users/f3af17559af04b71bfeb4178ee841514/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:50.717322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d080-3e42-4f81-908e-007b302f5ff5 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:50.732529 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d080-3e42-4f81-908e-007b302f5ff5 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:50.893630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09c10e-d2b1-4434-bf87-6f1fd211cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:50.904514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09c10e-d2b1-4434-bf87-6f1fd211cfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:50.910294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09c10e-d2b1-4434-bf87-6f1fd211cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:50.910838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09c10e-d2b1-4434-bf87-6f1fd211cfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:50.913403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09c10e-d2b1-4434-bf87-6f1fd211cfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:50.916855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09c10e-d2b1-4434-bf87-6f1fd211cfd7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:50.941125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 881/1757] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:08:50.950594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ded15-a918-44af-a6c4-044725f88a0b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:50.955503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f982866-58eb-4ed5-9128-8f51b1e885c9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:50.961123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f982866-58eb-4ed5-9128-8f51b1e885c9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:50.961123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f982866-58eb-4ed5-9128-8f51b1e885c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:50.987696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ded15-a918-44af-a6c4-044725f88a0b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:50.999639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ab604-17c3-4e72-a8f3-ad3603af2762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:51.000472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ab604-17c3-4e72-a8f3-ad3603af2762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:51.001066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ab604-17c3-4e72-a8f3-ad3603af2762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:51.001445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ab604-17c3-4e72-a8f3-ad3603af2762 admin admin] PATH_INFO: `/v3/projects/68f3a4cca93740f4a88aca32ec16ed1b/users/f3af17559af04b71bfeb4178ee841514/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:51.004557 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ab604-17c3-4e72-a8f3-ad3603af2762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f3a4cca93740f4a88aca32ec16ed1b, user_id=f3af17559af04b71bfeb4178ee841514, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:51.009851 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ab604-17c3-4e72-a8f3-ad3603af2762 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:51.049538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 877/1758] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:08:50 2022] PUT /identity/v3/projects/68f3a4cca93740f4a88aca32ec16ed1b/users/f3af17559af04b71bfeb4178ee841514/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:08:51.061157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:51.062797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffc366-4dbf-476f-9caa-4d8b0c78b185 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:51.064565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffc366-4dbf-476f-9caa-4d8b0c78b185 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:51.066257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffc366-4dbf-476f-9caa-4d8b0c78b185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:51.087380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7f982866-58eb-4ed5-9128-8f51b1e885c9 None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:51.090674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7f982866-58eb-4ed5-9128-8f51b1e885c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:51.119869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-44ffc366-4dbf-476f-9caa-4d8b0c78b185 None None] MFA Rules not processed for user `f3af17559af04b71bfeb4178ee841514`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:51.121369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-44ffc366-4dbf-476f-9caa-4d8b0c78b185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:51.296424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 878/1759] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:51.297492 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffc366-4dbf-476f-9caa-4d8b0c78b185 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:51.298005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 882/1760] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:08:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:51.303893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-44ffc366-4dbf-476f-9caa-4d8b0c78b185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:51.404748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffc366-4dbf-476f-9caa-4d8b0c78b185 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:51.412970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:51.413800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:51.414230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:51.415327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:51.417474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:51.583094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:51.585336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:51.605802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 879/1761] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:51.716554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f982866-58eb-4ed5-9128-8f51b1e885c9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:51.736649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f982866-58eb-4ed5-9128-8f51b1e885c9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:51.742425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf000b3-8de1-4c63-b414-c489ee0cb539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:51.744190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf000b3-8de1-4c63-b414-c489ee0cb539 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:51.744481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf000b3-8de1-4c63-b414-c489ee0cb539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:51.744761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf000b3-8de1-4c63-b414-c489ee0cb539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:51.772982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf000b3-8de1-4c63-b414-c489ee0cb539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:51.774442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf000b3-8de1-4c63-b414-c489ee0cb539 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:51.791663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:51.793298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:51.809096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 883/1762] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:08:51.870782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:52.044468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4afbc6-281d-4d56-bca0-1ecb3c7d4272 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:52.052719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8471c98-b26d-42eb-9eeb-eace4a1899a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:52.054235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8471c98-b26d-42eb-9eeb-eace4a1899a0 service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:52.054670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8471c98-b26d-42eb-9eeb-eace4a1899a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:52.055588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8471c98-b26d-42eb-9eeb-eace4a1899a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:52.076519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8471c98-b26d-42eb-9eeb-eace4a1899a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:52.078347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8471c98-b26d-42eb-9eeb-eace4a1899a0 service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:52.110062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 880/1763] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:08:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 18:08:52.672152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf000b3-8de1-4c63-b414-c489ee0cb539 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:52.682326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf000b3-8de1-4c63-b414-c489ee0cb539 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:52.700005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f779-3a91-4711-b8ca-5f744e6cc529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:52.705060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f779-3a91-4711-b8ca-5f744e6cc529 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:52.707018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f779-3a91-4711-b8ca-5f744e6cc529 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:52.708319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f779-3a91-4711-b8ca-5f744e6cc529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:52.954428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f779-3a91-4711-b8ca-5f744e6cc529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:52.957867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f779-3a91-4711-b8ca-5f744e6cc529 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:52.989996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 884/1764] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:53.757966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:53.870339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ed34-7ef4-49be-8c5b-865b7f17deb7 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:53.870776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ed34-7ef4-49be-8c5b-865b7f17deb7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:53.871171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ed34-7ef4-49be-8c5b-865b7f17deb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:53.907444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-59d7ed34-7ef4-49be-8c5b-865b7f17deb7 None None] MFA Rules not processed for user `9b585090272c4b4ab7d1937ebc9fa649`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:53.910150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-59d7ed34-7ef4-49be-8c5b-865b7f17deb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:54.077765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 881/1765] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:54.265784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cd391-7437-4ced-9922-19f22e8d92b4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:54.266845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cd391-7437-4ced-9922-19f22e8d92b4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:54.267496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cd391-7437-4ced-9922-19f22e8d92b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:54.347649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ca4cd391-7437-4ced-9922-19f22e8d92b4 None None] MFA Rules not processed for user `0116171a83f5444d91ce0ea2439a9bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:54.349349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ca4cd391-7437-4ced-9922-19f22e8d92b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:54.427717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ed34-7ef4-49be-8c5b-865b7f17deb7 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:54.446556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ed34-7ef4-49be-8c5b-865b7f17deb7 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:54.457287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc419b2b-08f0-426a-a4ca-fd9f84fa27cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:54.458714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 885/1766] 10.222.0.102 () {58 vars in 1016 bytes} [Thu Jul 28 18:08:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:54.458974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc419b2b-08f0-426a-a4ca-fd9f84fa27cf service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:54.460031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc419b2b-08f0-426a-a4ca-fd9f84fa27cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:54.461185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc419b2b-08f0-426a-a4ca-fd9f84fa27cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:54.548828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cd391-7437-4ced-9922-19f22e8d92b4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:54.552223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ca4cd391-7437-4ced-9922-19f22e8d92b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:54.571761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cd391-7437-4ced-9922-19f22e8d92b4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:54.578083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644f70-9c88-4675-a2a3-7251e6a46e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:54.579617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644f70-9c88-4675-a2a3-7251e6a46e38 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:54.580047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644f70-9c88-4675-a2a3-7251e6a46e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:54.580616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644f70-9c88-4675-a2a3-7251e6a46e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:54.592703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69644f70-9c88-4675-a2a3-7251e6a46e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:54.594654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69644f70-9c88-4675-a2a3-7251e6a46e38 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:54.606191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 886/1767] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:54.705094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc419b2b-08f0-426a-a4ca-fd9f84fa27cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:54.707636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc419b2b-08f0-426a-a4ca-fd9f84fa27cf service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:54.739136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 882/1768] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:08:55.152274 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:55.367845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644f70-9c88-4675-a2a3-7251e6a46e38 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:55.367845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-69644f70-9c88-4675-a2a3-7251e6a46e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:55.473832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644f70-9c88-4675-a2a3-7251e6a46e38 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:55.493111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:55.494097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:55.494559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:55.495004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] PATH_INFO: `/v3/users/0df038ecdf084422af24a96616d566d2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:55.496724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df038ecdf084422af24a96616d566d2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:55.498667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:55.904485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df038ecdf084422af24a96616d566d2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:55.905152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df038ecdf084422af24a96616d566d2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:55.916543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df038ecdf084422af24a96616d566d2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:55.919763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df038ecdf084422af24a96616d566d2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:55.949438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e5988b6c-3ef9-4301-9f95-4e1a4e65823a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df038ecdf084422af24a96616d566d2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:56.059627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f44f-b735-4114-a38c-e0afee492cf2 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:56.060261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f44f-b735-4114-a38c-e0afee492cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:56.060261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f44f-b735-4114-a38c-e0afee492cf2 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:56.061869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 883/1769] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 28 18:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:08:56.068223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6968e0-c0f2-4cdc-a392-38299e3ec6d0 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:56.068731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6968e0-c0f2-4cdc-a392-38299e3ec6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:56.073143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6968e0-c0f2-4cdc-a392-38299e3ec6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:56.097753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-3e6968e0-c0f2-4cdc-a392-38299e3ec6d0 None None] MFA Rules not processed for user `0116171a83f5444d91ce0ea2439a9bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:56.099135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-3e6968e0-c0f2-4cdc-a392-38299e3ec6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:56.112770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 884/1770] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:08:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:56.159196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6968e0-c0f2-4cdc-a392-38299e3ec6d0 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:56.175334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-3e6968e0-c0f2-4cdc-a392-38299e3ec6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:56.243555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 887/1771] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:08:55 2022] DELETE /identity/v3/users/0df038ecdf084422af24a96616d566d2 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:56.245622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016f632-1649-47ee-a0b0-78f8acba13c7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:56.245941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016f632-1649-47ee-a0b0-78f8acba13c7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:56.246280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016f632-1649-47ee-a0b0-78f8acba13c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:56.256733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6968e0-c0f2-4cdc-a392-38299e3ec6d0 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:56.312680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d016f632-1649-47ee-a0b0-78f8acba13c7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:56.314025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d016f632-1649-47ee-a0b0-78f8acba13c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:56.392673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a3bd8-1417-4e86-ba0a-7ffb42fd36b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:56.396950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a3bd8-1417-4e86-ba0a-7ffb42fd36b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:56.396950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a3bd8-1417-4e86-ba0a-7ffb42fd36b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:56.396950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a3bd8-1417-4e86-ba0a-7ffb42fd36b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:56.403952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a3bd8-1417-4e86-ba0a-7ffb42fd36b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:56.405984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a3bd8-1417-4e86-ba0a-7ffb42fd36b2 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:56.420901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 885/1772] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:56.422225 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9c0c8-c1a6-4526-a077-c42523c88f6d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:56.422514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9c0c8-c1a6-4526-a077-c42523c88f6d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:56.423327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9c0c8-c1a6-4526-a077-c42523c88f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:56.450881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-d6b9c0c8-c1a6-4526-a077-c42523c88f6d None None] MFA Rules not processed for user `7388d3603bbd428cabf62a1f46e73929`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:56.453183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d6b9c0c8-c1a6-4526-a077-c42523c88f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:56.486838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 888/1773] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:56.497839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016f632-1649-47ee-a0b0-78f8acba13c7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:56.500834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d016f632-1649-47ee-a0b0-78f8acba13c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:56.517027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016f632-1649-47ee-a0b0-78f8acba13c7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:56.521130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75648ac-fb8e-434c-b821-694b1fe5e9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:56.522334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75648ac-fb8e-434c-b821-694b1fe5e9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:56.522619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75648ac-fb8e-434c-b821-694b1fe5e9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:56.522900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75648ac-fb8e-434c-b821-694b1fe5e9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:56.534217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75648ac-fb8e-434c-b821-694b1fe5e9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:56.535677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75648ac-fb8e-434c-b821-694b1fe5e9e3 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:56.548585 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 889/1774] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:08:56.560539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 886/1775] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:08:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:08:56.586990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:57.755080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75648ac-fb8e-434c-b821-694b1fe5e9e3 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:57.756087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e75648ac-fb8e-434c-b821-694b1fe5e9e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:57.796396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75648ac-fb8e-434c-b821-694b1fe5e9e3 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:57.805261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:57.809598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:57.817236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:57.817760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] PATH_INFO: `/v3/projects/69d9a6abc7e348ccbe17ae070021738d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:57.832125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d9a6abc7e348ccbe17ae070021738d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:57.847578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:58.113391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d9a6abc7e348ccbe17ae070021738d', 'request_id': 'req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:58.244124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61292458-1b8a-4f25-8427-1823fc9369e0 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:58.244124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61292458-1b8a-4f25-8427-1823fc9369e0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:58.244124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61292458-1b8a-4f25-8427-1823fc9369e0 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:58.248160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 887/1776] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:08:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:08:58.254076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526730e-37c3-49af-9951-0ca50192ede5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:58.254582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526730e-37c3-49af-9951-0ca50192ede5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:58.255057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526730e-37c3-49af-9951-0ca50192ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:58.283877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f526730e-37c3-49af-9951-0ca50192ede5 None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:08:58.286703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f526730e-37c3-49af-9951-0ca50192ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:58.323209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d9a6abc7e348ccbe17ae070021738d', 'request_id': 'req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:58.345930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d9a6abc7e348ccbe17ae070021738d', 'request_id': 'req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:58.399719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] The token cache is being invalidate because project 69d9a6abc7e348ccbe17ae070021738d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:08:58.400821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:58.404072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:58.413334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 890/1777] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:08:57 2022] DELETE /identity/v3/projects/69d9a6abc7e348ccbe17ae070021738d => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:08:58.417785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:58.421332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:58.453750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 888/1778] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:08:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:08:58.524819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526730e-37c3-49af-9951-0ca50192ede5 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:08:58.527348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f526730e-37c3-49af-9951-0ca50192ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:58.573607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526730e-37c3-49af-9951-0ca50192ede5 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:58.588365 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f9e1-33de-463f-9de2-379620f8738d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:58.591253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f9e1-33de-463f-9de2-379620f8738d service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:58.591696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f9e1-33de-463f-9de2-379620f8738d service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:58.592142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f9e1-33de-463f-9de2-379620f8738d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:58.602467 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9017f9e1-33de-463f-9de2-379620f8738d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:08:58.636656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf819-0aa5-4d84-ad28-f30ba16bcdeb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:08:58.644247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f9e1-33de-463f-9de2-379620f8738d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:58.646269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f9e1-33de-463f-9de2-379620f8738d service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:58.656257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:58.665338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:08:58.666006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:08:58.666289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:08:58.666565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] PATH_INFO: `/v3/users/aa082b197b1c4c0bbf0bb3be87b949f7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:08:58.668049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa082b197b1c4c0bbf0bb3be87b949f7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:08:58.674296 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:08:58.682765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 889/1779] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:08:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:08:59.098799 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa082b197b1c4c0bbf0bb3be87b949f7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:59.099696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa082b197b1c4c0bbf0bb3be87b949f7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:59.118234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa082b197b1c4c0bbf0bb3be87b949f7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:59.119096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa082b197b1c4c0bbf0bb3be87b949f7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:59.144972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa082b197b1c4c0bbf0bb3be87b949f7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:08:59.666513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 891/1780] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:08:58 2022] DELETE /identity/v3/users/aa082b197b1c4c0bbf0bb3be87b949f7 => generated 0 bytes in 1250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:00.505599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f9e1-33de-463f-9de2-379620f8738d service nova] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:00.535446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f9e1-33de-463f-9de2-379620f8738d service nova] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:00.547423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:00.550096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:00.720167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515912-b832-4274-8a17-bc6169ce8e39 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:00.745544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:00.751089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:00.751089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:00.751758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] PATH_INFO: `/v3/users/ef5d98d843b94ef090d48c78e7cc478a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:00.755666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5d98d843b94ef090d48c78e7cc478a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:00.761777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:00.769948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:00.771194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:00.771668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:00.772144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] PATH_INFO: `/v3/projects/dc66da9fb9e74656b343a0097c509957` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:00.773943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc66da9fb9e74656b343a0097c509957)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:00.776596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:01.225800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:01.373573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc66da9fb9e74656b343a0097c509957', 'request_id': 'req-afb1aef3-4532-445b-9561-a2041d020100'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.380343 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc66da9fb9e74656b343a0097c509957', 'request_id': 'req-afb1aef3-4532-445b-9561-a2041d020100'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.620322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc66da9fb9e74656b343a0097c509957', 'request_id': 'req-afb1aef3-4532-445b-9561-a2041d020100'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.637206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5d98d843b94ef090d48c78e7cc478a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.638346 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5d98d843b94ef090d48c78e7cc478a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.663261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5d98d843b94ef090d48c78e7cc478a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.664291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5d98d843b94ef090d48c78e7cc478a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.671176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] The token cache is being invalidate because project dc66da9fb9e74656b343a0097c509957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:01.671539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.673475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-afb1aef3-4532-445b-9561-a2041d020100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.680892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 890/1781] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:00 2022] DELETE /identity/v3/projects/dc66da9fb9e74656b343a0097c509957 => generated 0 bytes in 1172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:01.682480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ddb4-3efd-4263-b1a1-14290ce02097 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:01.682815 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ddb4-3efd-4263-b1a1-14290ce02097 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:01.683088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ddb4-3efd-4263-b1a1-14290ce02097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:01.704263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-05ef0228-fb65-49ce-aa9f-8c12a0deff5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5d98d843b94ef090d48c78e7cc478a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:01.750092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b412ddb4-3efd-4263-b1a1-14290ce02097 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:01.751605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b412ddb4-3efd-4263-b1a1-14290ce02097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:01.810379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 892/1782] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:00 2022] DELETE /identity/v3/users/ef5d98d843b94ef090d48c78e7cc478a => generated 0 bytes in 1263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:01.814966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f83a12-63e2-45aa-b9b1-92e560fc4e7e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:01.815533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f83a12-63e2-45aa-b9b1-92e560fc4e7e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:01.816119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f83a12-63e2-45aa-b9b1-92e560fc4e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:01.856595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 891/1783] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:01.864559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-40f83a12-63e2-45aa-b9b1-92e560fc4e7e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:01.864559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-40f83a12-63e2-45aa-b9b1-92e560fc4e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:01.866098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddf46c-0887-4399-b902-4b2e5385aed7 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:01.866460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddf46c-0887-4399-b902-4b2e5385aed7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:01.866724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddf46c-0887-4399-b902-4b2e5385aed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:01.904045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-74ddf46c-0887-4399-b902-4b2e5385aed7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:01.909702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-74ddf46c-0887-4399-b902-4b2e5385aed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:02.009345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 893/1784] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:02.011128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f83a12-63e2-45aa-b9b1-92e560fc4e7e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:02.012698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-40f83a12-63e2-45aa-b9b1-92e560fc4e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:02.024266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 892/1785] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:02.030210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddf46c-0887-4399-b902-4b2e5385aed7 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:02.069032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddf46c-0887-4399-b902-4b2e5385aed7 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:02.076763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34223bfa-3ca8-426f-b9d6-cbcc77f4f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:02.076763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223bfa-3ca8-426f-b9d6-cbcc77f4f0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:02.077440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223bfa-3ca8-426f-b9d6-cbcc77f4f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:02.078006 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34223bfa-3ca8-426f-b9d6-cbcc77f4f0cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:02.083142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34223bfa-3ca8-426f-b9d6-cbcc77f4f0cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:02.083548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34223bfa-3ca8-426f-b9d6-cbcc77f4f0cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:02.085606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34223bfa-3ca8-426f-b9d6-cbcc77f4f0cc admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:02.108642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f83a12-63e2-45aa-b9b1-92e560fc4e7e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:02.116290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e77af2-9ed2-4b29-a453-4bbeb201790a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:02.117879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e77af2-9ed2-4b29-a453-4bbeb201790a service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:02.118168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e77af2-9ed2-4b29-a453-4bbeb201790a service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:02.118446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e77af2-9ed2-4b29-a453-4bbeb201790a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:02.122250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 893/1786] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:09:02.128167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34223bfa-3ca8-426f-b9d6-cbcc77f4f0cc admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:02.136413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e77af2-9ed2-4b29-a453-4bbeb201790a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:02.138152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e77af2-9ed2-4b29-a453-4bbeb201790a service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:02.151115 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34223bfa-3ca8-426f-b9d6-cbcc77f4f0cc admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:02.154180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 894/1787] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:02.157897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ab7d5-2e87-4604-ba73-ccd94631a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:02.158833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ab7d5-2e87-4604-ba73-ccd94631a192 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:02.159372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ab7d5-2e87-4604-ba73-ccd94631a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:02.159884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ab7d5-2e87-4604-ba73-ccd94631a192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:02.161561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ab7d5-2e87-4604-ba73-ccd94631a192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:02.165800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ab7d5-2e87-4604-ba73-ccd94631a192 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:02.285066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 894/1788] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:02 2022] POST /identity/v3/projects => generated 355 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:02.288690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e77af2-9ed2-4b29-a453-4bbeb201790a service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:02.303584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e77af2-9ed2-4b29-a453-4bbeb201790a service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:02.421668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d479f7c-6ba9-4dea-a38a-5dc87f8a90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:02.422623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d479f7c-6ba9-4dea-a38a-5dc87f8a90bb admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:02.424263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d479f7c-6ba9-4dea-a38a-5dc87f8a90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:02.424971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d479f7c-6ba9-4dea-a38a-5dc87f8a90bb admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:02.426133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d479f7c-6ba9-4dea-a38a-5dc87f8a90bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:02.429715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d479f7c-6ba9-4dea-a38a-5dc87f8a90bb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:02.654828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 895/1789] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:02 2022] POST /identity/v3/users => generated 278 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:02.659152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ab7d5-2e87-4604-ba73-ccd94631a192 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:02.670629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ab7d5-2e87-4604-ba73-ccd94631a192 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:02.676555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260c515-f233-4aa9-a213-dd2f5517d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:02.677510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260c515-f233-4aa9-a213-dd2f5517d9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:02.678021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260c515-f233-4aa9-a213-dd2f5517d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:02.678478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260c515-f233-4aa9-a213-dd2f5517d9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:02.679202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260c515-f233-4aa9-a213-dd2f5517d9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:02.681259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260c515-f233-4aa9-a213-dd2f5517d9fb admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:02.695619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 895/1790] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:02.697038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d479f7c-6ba9-4dea-a38a-5dc87f8a90bb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:02.710123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d479f7c-6ba9-4dea-a38a-5dc87f8a90bb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:02.716974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119925e9-eae3-47b7-914c-73018872ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:02.720294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119925e9-eae3-47b7-914c-73018872ad1f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:02.720294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119925e9-eae3-47b7-914c-73018872ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:02.720294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119925e9-eae3-47b7-914c-73018872ad1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:02.720294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119925e9-eae3-47b7-914c-73018872ad1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:02.720592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119925e9-eae3-47b7-914c-73018872ad1f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:02.736677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 896/1791] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:02.738053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260c515-f233-4aa9-a213-dd2f5517d9fb admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:02.757375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260c515-f233-4aa9-a213-dd2f5517d9fb admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:02.769123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40058b-4d9b-449d-b4cb-73d76139238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:02.770062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40058b-4d9b-449d-b4cb-73d76139238b admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:02.770553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40058b-4d9b-449d-b4cb-73d76139238b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:02.771044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40058b-4d9b-449d-b4cb-73d76139238b admin admin] PATH_INFO: `/v3/projects/43dbeeee7d90435e9af46f3098ab25c2/users/c39e9c35eb904c95a08fb382b625eb91/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:02.792684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119925e9-eae3-47b7-914c-73018872ad1f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:02.797947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-119925e9-eae3-47b7-914c-73018872ad1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:02.803824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40058b-4d9b-449d-b4cb-73d76139238b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43dbeeee7d90435e9af46f3098ab25c2, user_id=c39e9c35eb904c95a08fb382b625eb91, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:02.806996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40058b-4d9b-449d-b4cb-73d76139238b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:02.819705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119925e9-eae3-47b7-914c-73018872ad1f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:02.839532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:02.841680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:02.842231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:02.842757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] PATH_INFO: `/v3/users/0503c896d6eb4f8da3b2fc8f248a73e4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:02.850126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0503c896d6eb4f8da3b2fc8f248a73e4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:02.852206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:02.912972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 896/1792] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:02 2022] PUT /identity/v3/projects/43dbeeee7d90435e9af46f3098ab25c2/users/c39e9c35eb904c95a08fb382b625eb91/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:02.912972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40058b-4d9b-449d-b4cb-73d76139238b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:02.914563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-be40058b-4d9b-449d-b4cb-73d76139238b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:02.994637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40058b-4d9b-449d-b4cb-73d76139238b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:02.999673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:03.000329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:03.000616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:03.000925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] PATH_INFO: `/v3/projects/71534537093d4ea7a543c5ce5de58e11` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:03.002136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=71534537093d4ea7a543c5ce5de58e11)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:03.004078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:03.170456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0503c896d6eb4f8da3b2fc8f248a73e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.171189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0503c896d6eb4f8da3b2fc8f248a73e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.182457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0503c896d6eb4f8da3b2fc8f248a73e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.183245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0503c896d6eb4f8da3b2fc8f248a73e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.197324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e4e8e853-226e-42a8-b42a-eeecf0bab3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0503c896d6eb4f8da3b2fc8f248a73e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.199608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71534537093d4ea7a543c5ce5de58e11', 'request_id': 'req-8e2acefa-9588-4cee-a98c-4b8c36390e8e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.205395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71534537093d4ea7a543c5ce5de58e11', 'request_id': 'req-8e2acefa-9588-4cee-a98c-4b8c36390e8e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.305565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 897/1793] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:02 2022] DELETE /identity/v3/users/0503c896d6eb4f8da3b2fc8f248a73e4 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:03.306973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559166ab-5e37-4506-91e3-a59085602dff None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:03.307269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559166ab-5e37-4506-91e3-a59085602dff None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:03.307547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559166ab-5e37-4506-91e3-a59085602dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:03.334701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-559166ab-5e37-4506-91e3-a59085602dff None None] MFA Rules not processed for user `c39e9c35eb904c95a08fb382b625eb91`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:03.341990 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-559166ab-5e37-4506-91e3-a59085602dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:03.402059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 898/1794] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:03.403302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f971286-10df-4d4c-8b10-8b43a8fcb1c0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:03.403602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f971286-10df-4d4c-8b10-8b43a8fcb1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:03.403883 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f971286-10df-4d4c-8b10-8b43a8fcb1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:03.426041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6f971286-10df-4d4c-8b10-8b43a8fcb1c0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:03.429054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6f971286-10df-4d4c-8b10-8b43a8fcb1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:03.454625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71534537093d4ea7a543c5ce5de58e11', 'request_id': 'req-8e2acefa-9588-4cee-a98c-4b8c36390e8e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.486893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] The token cache is being invalidate because project 71534537093d4ea7a543c5ce5de58e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:03.486893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.486893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.492873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 897/1795] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:02 2022] DELETE /identity/v3/projects/71534537093d4ea7a543c5ce5de58e11 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:03.493719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:03.495081 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:03.517447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 899/1796] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:03.518576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f971286-10df-4d4c-8b10-8b43a8fcb1c0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:03.520538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6f971286-10df-4d4c-8b10-8b43a8fcb1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:03.543557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f971286-10df-4d4c-8b10-8b43a8fcb1c0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:03.549299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:03.550007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:03.550666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:03.550942 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] PATH_INFO: `/v3/users/54fd2b67559343c6babd59e686be8eab` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:03.552149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fd2b67559343c6babd59e686be8eab)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:03.554159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:03.592302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:03.613054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acefa-9588-4cee-a98c-4b8c36390e8e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:03.618344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d4cf-3579-4c47-a802-d316d01ca348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:03.619093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d4cf-3579-4c47-a802-d316d01ca348 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:03.619460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d4cf-3579-4c47-a802-d316d01ca348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:03.619828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d4cf-3579-4c47-a802-d316d01ca348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:03.620669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0d4cf-3579-4c47-a802-d316d01ca348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:03.622806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0d4cf-3579-4c47-a802-d316d01ca348 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:03.762968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 898/1797] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:03 2022] POST /identity/v3/projects => generated 357 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:03.764653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d4cf-3579-4c47-a802-d316d01ca348 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:03.766718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-93e0d4cf-3579-4c47-a802-d316d01ca348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:03.850350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d4cf-3579-4c47-a802-d316d01ca348 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:03.861915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fd2b67559343c6babd59e686be8eab'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.862692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fd2b67559343c6babd59e686be8eab'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.864538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928802c-0e5d-4bcb-9a73-434aab277b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:03.869440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928802c-0e5d-4bcb-9a73-434aab277b23 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:03.871999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928802c-0e5d-4bcb-9a73-434aab277b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:03.871999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928802c-0e5d-4bcb-9a73-434aab277b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:03.874637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fd2b67559343c6babd59e686be8eab'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.875430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fd2b67559343c6babd59e686be8eab'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.892171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fd2b67559343c6babd59e686be8eab'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:03.940935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928802c-0e5d-4bcb-9a73-434aab277b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:03.942404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928802c-0e5d-4bcb-9a73-434aab277b23 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:03.954054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 899/1798] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:03.954692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 900/1799] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:03 2022] DELETE /identity/v3/users/54fd2b67559343c6babd59e686be8eab => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:03.957727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928802c-0e5d-4bcb-9a73-434aab277b23 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:03.967646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928802c-0e5d-4bcb-9a73-434aab277b23 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:04.035586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f8dac-8a87-4fcf-bb26-55b150201bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:04.036209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f8dac-8a87-4fcf-bb26-55b150201bac admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:04.036486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f8dac-8a87-4fcf-bb26-55b150201bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:04.036761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f8dac-8a87-4fcf-bb26-55b150201bac admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:04.038856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f8dac-8a87-4fcf-bb26-55b150201bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:04.040961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f8dac-8a87-4fcf-bb26-55b150201bac admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:04.174030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 900/1800] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:03 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:04.175708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:04.177440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:04.191715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c4f2e-9598-406e-b5b5-29bea3a6662d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:04.198102 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5f194-522c-4eb2-b8aa-dc1ef620756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:04.198974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5f194-522c-4eb2-b8aa-dc1ef620756c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:04.199779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5f194-522c-4eb2-b8aa-dc1ef620756c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:04.200140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5f194-522c-4eb2-b8aa-dc1ef620756c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:04.200966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5f194-522c-4eb2-b8aa-dc1ef620756c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:04.202728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5f194-522c-4eb2-b8aa-dc1ef620756c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:04.216126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 901/1801] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:04.223454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f8dac-8a87-4fcf-bb26-55b150201bac admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:04.237298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f8dac-8a87-4fcf-bb26-55b150201bac admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:04.242750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec027a-944d-4a32-b115-6a3f75d46928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:04.243563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec027a-944d-4a32-b115-6a3f75d46928 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:04.243793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec027a-944d-4a32-b115-6a3f75d46928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:04.244125 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec027a-944d-4a32-b115-6a3f75d46928 admin admin] PATH_INFO: `/v3/projects/0e27f111584e400c9c42f0aff3d826cd/users/40de29cf276e4771b12b2aeaf876815e/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:04.267319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec027a-944d-4a32-b115-6a3f75d46928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e27f111584e400c9c42f0aff3d826cd, user_id=40de29cf276e4771b12b2aeaf876815e, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:04.270991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec027a-944d-4a32-b115-6a3f75d46928 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:04.390003 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 901/1802] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:04 2022] PUT /identity/v3/projects/0e27f111584e400c9c42f0aff3d826cd/users/40de29cf276e4771b12b2aeaf876815e/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:04.392921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5f194-522c-4eb2-b8aa-dc1ef620756c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:04.403468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5f194-522c-4eb2-b8aa-dc1ef620756c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:04.486366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2135b9c-ffea-4e5d-a4b3-b37b60fbeb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:04.487081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2135b9c-ffea-4e5d-a4b3-b37b60fbeb0f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:04.487617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2135b9c-ffea-4e5d-a4b3-b37b60fbeb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:04.487966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2135b9c-ffea-4e5d-a4b3-b37b60fbeb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:04.488812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2135b9c-ffea-4e5d-a4b3-b37b60fbeb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:04.490700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2135b9c-ffea-4e5d-a4b3-b37b60fbeb0f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:04.504624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 902/1803] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:04.505577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec027a-944d-4a32-b115-6a3f75d46928 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:04.516605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec027a-944d-4a32-b115-6a3f75d46928 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:04.522406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b10ba-4049-4496-9e12-6a4d9dea1177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:04.524892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b10ba-4049-4496-9e12-6a4d9dea1177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:04.524892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b10ba-4049-4496-9e12-6a4d9dea1177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:04.524892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b10ba-4049-4496-9e12-6a4d9dea1177 admin admin] PATH_INFO: `/v3/projects/0e27f111584e400c9c42f0aff3d826cd/users/40de29cf276e4771b12b2aeaf876815e/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:04.526128 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b10ba-4049-4496-9e12-6a4d9dea1177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e27f111584e400c9c42f0aff3d826cd, user_id=40de29cf276e4771b12b2aeaf876815e, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:04.528897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b10ba-4049-4496-9e12-6a4d9dea1177 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:04.540444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 902/1804] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:04 2022] PUT /identity/v3/projects/0e27f111584e400c9c42f0aff3d826cd/users/40de29cf276e4771b12b2aeaf876815e/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:04.551262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fc9e0-496c-4efc-ad2d-b8de458d3a25 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:04.551262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fc9e0-496c-4efc-ad2d-b8de458d3a25 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:04.551789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fc9e0-496c-4efc-ad2d-b8de458d3a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:04.585724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1e8fc9e0-496c-4efc-ad2d-b8de458d3a25 None None] MFA Rules not processed for user `40de29cf276e4771b12b2aeaf876815e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:04.587382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1e8fc9e0-496c-4efc-ad2d-b8de458d3a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:04.654919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b10ba-4049-4496-9e12-6a4d9dea1177 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:04.654919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a53b10ba-4049-4496-9e12-6a4d9dea1177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:04.760681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 903/1805] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:04 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:04.761616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fc9e0-496c-4efc-ad2d-b8de458d3a25 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:04.767532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1e8fc9e0-496c-4efc-ad2d-b8de458d3a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:04.818125 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b10ba-4049-4496-9e12-6a4d9dea1177 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:04.824620 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:04.825562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:04.825987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:04.838383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] PATH_INFO: `/v3/projects/a87ec4749856445dacabd4d13d9b3c3c` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:04.842570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a87ec4749856445dacabd4d13d9b3c3c)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:04.848253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:04.867237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fc9e0-496c-4efc-ad2d-b8de458d3a25 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:04.872246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:04.873214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:04.873501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:04.873974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] PATH_INFO: `/v3/projects/d0a4df3a9a424eb89a241f69902f5d9c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:04.874967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a4df3a9a424eb89a241f69902f5d9c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:04.877817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:05.008704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a4df3a9a424eb89a241f69902f5d9c', 'request_id': 'req-2fee4328-8d99-4d09-b35e-fbd8d457b417'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.040525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a87ec4749856445dacabd4d13d9b3c3c', 'request_id': 'req-65512a51-c494-4cba-a680-8bad4bacc7d7'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.051454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a87ec4749856445dacabd4d13d9b3c3c', 'request_id': 'req-65512a51-c494-4cba-a680-8bad4bacc7d7'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.120346 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a4df3a9a424eb89a241f69902f5d9c', 'request_id': 'req-2fee4328-8d99-4d09-b35e-fbd8d457b417'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.131289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a4df3a9a424eb89a241f69902f5d9c', 'request_id': 'req-2fee4328-8d99-4d09-b35e-fbd8d457b417'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.145492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] The token cache is being invalidate because project d0a4df3a9a424eb89a241f69902f5d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:05.145788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.147259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.152428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:05.152976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 904/1806] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:04 2022] DELETE /identity/v3/projects/d0a4df3a9a424eb89a241f69902f5d9c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:05.154208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:05.160320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:05.213765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a87ec4749856445dacabd4d13d9b3c3c', 'request_id': 'req-65512a51-c494-4cba-a680-8bad4bacc7d7'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.233808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee4328-8d99-4d09-b35e-fbd8d457b417 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:05.233943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] The token cache is being invalidate because project a87ec4749856445dacabd4d13d9b3c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:05.234163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.234835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.239353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 903/1807] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:04 2022] DELETE /identity/v3/projects/a87ec4749856445dacabd4d13d9b3c3c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:05.240294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:05.241807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:05.289629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:05.290972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:05.290972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:05.290972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:05.292561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:05.311876 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512a51-c494-4cba-a680-8bad4bacc7d7 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:05.317372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:05.318209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:05.318659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:05.319010 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] PATH_INFO: `/v3/users/d9f810ac68f54ddca4692c533fc791b4` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:05.320431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f810ac68f54ddca4692c533fc791b4)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:05.322521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:05.365287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:05.366891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:05.377234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 905/1808] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:05 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:05.378053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:05.379349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:05.394773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c716b-a1c4-468e-bab5-458329f5ce9d service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:05.400768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:05.401460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:05.401746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:05.402024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] PATH_INFO: `/v3/users/216772204be1430597b0fb9488638386` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:05.403254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=216772204be1430597b0fb9488638386)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:05.405272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:05.651469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f810ac68f54ddca4692c533fc791b4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.652186 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f810ac68f54ddca4692c533fc791b4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.691369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216772204be1430597b0fb9488638386'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.692046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216772204be1430597b0fb9488638386'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.699691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216772204be1430597b0fb9488638386'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.700352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216772204be1430597b0fb9488638386'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.712896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216772204be1430597b0fb9488638386'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.757374 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f810ac68f54ddca4692c533fc791b4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.760198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f810ac68f54ddca4692c533fc791b4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.774995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f810ac68f54ddca4692c533fc791b4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:05.789647 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 904/1809] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:05 2022] DELETE /identity/v3/users/d9f810ac68f54ddca4692c533fc791b4 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:05.790516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:05.791895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:05.864851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 906/1810] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:05 2022] DELETE /identity/v3/users/216772204be1430597b0fb9488638386 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:05.881203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02471140-9695-4078-b204-cfa0d7b53a4f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:05.938299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:05.939046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:05.939198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:05.939482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:05.942082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:06.020541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:06.022675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:06.033505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 905/1811] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:05 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:06.183168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:06.483011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:06.769200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:06.770923 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:06.797528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:06.799570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:06.866768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95be483-91dd-4bd6-84bb-659c27b2c03b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:06.874373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:06.876377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:06.876670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:06.877008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] PATH_INFO: `/v3/users/064c5fe9f43e471ca1c6a10c20b48422` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:06.878336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=064c5fe9f43e471ca1c6a10c20b48422)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:06.880375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:06.933051 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffde85-508f-4de3-ac6c-e5ebaafbdd54 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:06.937906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:06.938344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:06.938609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:06.938907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] PATH_INFO: `/v3/projects/aaac9b187b70474180b16efd4dfde1b4` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:06.940162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaac9b187b70474180b16efd4dfde1b4)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:06.942100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:07.180386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064c5fe9f43e471ca1c6a10c20b48422'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.181469 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064c5fe9f43e471ca1c6a10c20b48422'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.190559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064c5fe9f43e471ca1c6a10c20b48422'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.190771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaac9b187b70474180b16efd4dfde1b4', 'request_id': 'req-8bdbade1-dc88-4511-ad76-52287f3c0047'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.191767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064c5fe9f43e471ca1c6a10c20b48422'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.197298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaac9b187b70474180b16efd4dfde1b4', 'request_id': 'req-8bdbade1-dc88-4511-ad76-52287f3c0047'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.208954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5f35521c-f5b4-469d-bcc2-6bea6780a1b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064c5fe9f43e471ca1c6a10c20b48422'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.334821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaac9b187b70474180b16efd4dfde1b4', 'request_id': 'req-8bdbade1-dc88-4511-ad76-52287f3c0047'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.348473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] The token cache is being invalidate because project aaac9b187b70474180b16efd4dfde1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:07.348762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.349581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.351120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 906/1812] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:06 2022] DELETE /identity/v3/projects/aaac9b187b70474180b16efd4dfde1b4 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:07.352027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:07.353606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:07.430862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbade1-dc88-4511-ad76-52287f3c0047 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:07.436313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:07.436998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:07.437278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:07.437555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] PATH_INFO: `/v3/projects/25b0b90baf254474852ab684145aa523` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:07.438782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b0b90baf254474852ab684145aa523)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:07.440694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:07.499436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 907/1813] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:06 2022] DELETE /identity/v3/users/064c5fe9f43e471ca1c6a10c20b48422 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:07.500669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d776030-c042-4637-90ea-85ea24bdd6fb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:07.501000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d776030-c042-4637-90ea-85ea24bdd6fb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:07.503846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d776030-c042-4637-90ea-85ea24bdd6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:07.527236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8d776030-c042-4637-90ea-85ea24bdd6fb None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:07.529097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8d776030-c042-4637-90ea-85ea24bdd6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:07.605466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 908/1814] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:07.606494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b11de9-ed49-4f8c-93b0-4505fd9ac50e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:07.606778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b11de9-ed49-4f8c-93b0-4505fd9ac50e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:07.607055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b11de9-ed49-4f8c-93b0-4505fd9ac50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:07.627839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-15b11de9-ed49-4f8c-93b0-4505fd9ac50e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:07.629211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-15b11de9-ed49-4f8c-93b0-4505fd9ac50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:07.640457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 909/1815] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:07.642295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece9c31-ce57-430b-895d-33a199871395 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:07.642731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece9c31-ce57-430b-895d-33a199871395 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:07.643178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece9c31-ce57-430b-895d-33a199871395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:07.666849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9ece9c31-ce57-430b-895d-33a199871395 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:07.668305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9ece9c31-ce57-430b-895d-33a199871395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:07.671670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b0b90baf254474852ab684145aa523', 'request_id': 'req-6070a8c3-10f3-4df3-8b35-013a227c0a35'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.680357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b0b90baf254474852ab684145aa523', 'request_id': 'req-6070a8c3-10f3-4df3-8b35-013a227c0a35'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.747077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 910/1816] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:07.748005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece9c31-ce57-430b-895d-33a199871395 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:07.749585 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9ece9c31-ce57-430b-895d-33a199871395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:07.805436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b0b90baf254474852ab684145aa523', 'request_id': 'req-6070a8c3-10f3-4df3-8b35-013a227c0a35'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.832121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] The token cache is being invalidate because project 25b0b90baf254474852ab684145aa523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:07.832890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.835384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:07.838141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 907/1817] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:07 2022] DELETE /identity/v3/projects/25b0b90baf254474852ab684145aa523 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:07.840387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:07.842452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:07.865917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece9c31-ce57-430b-895d-33a199871395 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:07.875867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070a8c3-10f3-4df3-8b35-013a227c0a35 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:07.885893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f23b02-45be-4271-bb6b-71ad9835c871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:07.886555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f23b02-45be-4271-bb6b-71ad9835c871 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:07.886837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f23b02-45be-4271-bb6b-71ad9835c871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:07.888881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f23b02-45be-4271-bb6b-71ad9835c871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:07.888993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-46f23b02-45be-4271-bb6b-71ad9835c871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:07.905170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2b0f2-b5a7-4690-90a5-4ebbae9bfadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:07.905809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2b0f2-b5a7-4690-90a5-4ebbae9bfadd admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:07.906276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2b0f2-b5a7-4690-90a5-4ebbae9bfadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:07.906704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2b0f2-b5a7-4690-90a5-4ebbae9bfadd admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:07.907560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2b0f2-b5a7-4690-90a5-4ebbae9bfadd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:07.908292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2b0f2-b5a7-4690-90a5-4ebbae9bfadd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:07.908428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f23b02-45be-4271-bb6b-71ad9835c871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:07.909953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f23b02-45be-4271-bb6b-71ad9835c871 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:07.910510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2b0f2-b5a7-4690-90a5-4ebbae9bfadd admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:07.924356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 911/1818] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:07.925947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b4ccf-abaf-4697-a238-d91aa7a78f05 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:07.926241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b4ccf-abaf-4697-a238-d91aa7a78f05 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:07.926570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b4ccf-abaf-4697-a238-d91aa7a78f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:07.940888 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 908/1819] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:09:07.945717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2b0f2-b5a7-4690-90a5-4ebbae9bfadd admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:07.957357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-553b4ccf-abaf-4697-a238-d91aa7a78f05 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:07.959028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-553b4ccf-abaf-4697-a238-d91aa7a78f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:07.971540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2b0f2-b5a7-4690-90a5-4ebbae9bfadd admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:07.974152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 912/1820] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:07.982421 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab310f-15c0-456a-bc08-31dbaa6f5480 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:07.982761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab310f-15c0-456a-bc08-31dbaa6f5480 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:07.983196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab310f-15c0-456a-bc08-31dbaa6f5480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:07.991535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81254fd-c753-4176-80f4-85de5e043217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:07.992501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81254fd-c753-4176-80f4-85de5e043217 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:07.993015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81254fd-c753-4176-80f4-85de5e043217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:07.993437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81254fd-c753-4176-80f4-85de5e043217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:07.994295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81254fd-c753-4176-80f4-85de5e043217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:07.996449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81254fd-c753-4176-80f4-85de5e043217 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.005493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bdab310f-15c0-456a-bc08-31dbaa6f5480 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:08.006940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bdab310f-15c0-456a-bc08-31dbaa6f5480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:08.021936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 913/1821] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:08.022931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab310f-15c0-456a-bc08-31dbaa6f5480 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.039919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab310f-15c0-456a-bc08-31dbaa6f5480 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.055047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e81149-212f-4f74-a516-b9c533e10659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.055736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81149-212f-4f74-a516-b9c533e10659 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.056014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81149-212f-4f74-a516-b9c533e10659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.056287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81149-212f-4f74-a516-b9c533e10659 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.057401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e81149-212f-4f74-a516-b9c533e10659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:08.057401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e81149-212f-4f74-a516-b9c533e10659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.062286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e81149-212f-4f74-a516-b9c533e10659 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.104149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 914/1822] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:09:08.108059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e81149-212f-4f74-a516-b9c533e10659 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.132168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 909/1823] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:07 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:08.136962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81254fd-c753-4176-80f4-85de5e043217 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.150155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e81149-212f-4f74-a516-b9c533e10659 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.259736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d39998-03cf-4dd9-8269-90568cdf61d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.260643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d39998-03cf-4dd9-8269-90568cdf61d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.260976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d39998-03cf-4dd9-8269-90568cdf61d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.261252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d39998-03cf-4dd9-8269-90568cdf61d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.261937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d39998-03cf-4dd9-8269-90568cdf61d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.268875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d39998-03cf-4dd9-8269-90568cdf61d3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.277293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81254fd-c753-4176-80f4-85de5e043217 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.284051 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c684d4d-1172-4291-8feb-30f3bbcd1d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.284699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c684d4d-1172-4291-8feb-30f3bbcd1d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.285014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c684d4d-1172-4291-8feb-30f3bbcd1d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.285293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c684d4d-1172-4291-8feb-30f3bbcd1d70 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.294258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c684d4d-1172-4291-8feb-30f3bbcd1d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.297148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c684d4d-1172-4291-8feb-30f3bbcd1d70 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.414291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 915/1824] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:08 2022] POST /identity/v3/projects => generated 407 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:08.420282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d39998-03cf-4dd9-8269-90568cdf61d3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.444813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 910/1825] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:08 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:08.457542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c684d4d-1172-4291-8feb-30f3bbcd1d70 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.489518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c684d4d-1172-4291-8feb-30f3bbcd1d70 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.582462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d39998-03cf-4dd9-8269-90568cdf61d3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.588694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7c9c5-4d24-49d3-a68d-b751cdbc1b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.589559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7c9c5-4d24-49d3-a68d-b751cdbc1b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.589900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7c9c5-4d24-49d3-a68d-b751cdbc1b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.592482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7c9c5-4d24-49d3-a68d-b751cdbc1b91 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.592482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7c9c5-4d24-49d3-a68d-b751cdbc1b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.593643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7c9c5-4d24-49d3-a68d-b751cdbc1b91 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.606256 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1daa86-524f-46f7-8c20-0e8fb82aacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.608243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1daa86-524f-46f7-8c20-0e8fb82aacdf admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.608729 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1daa86-524f-46f7-8c20-0e8fb82aacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.609966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1daa86-524f-46f7-8c20-0e8fb82aacdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.611205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1daa86-524f-46f7-8c20-0e8fb82aacdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.613431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1daa86-524f-46f7-8c20-0e8fb82aacdf admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.629124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 911/1826] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:08.630411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1daa86-524f-46f7-8c20-0e8fb82aacdf admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.638712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:08.648945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1daa86-524f-46f7-8c20-0e8fb82aacdf admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.655324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313617-25e5-431c-817e-efe5c506d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.656459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313617-25e5-431c-817e-efe5c506d3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.656812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313617-25e5-431c-817e-efe5c506d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.657394 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58313617-25e5-431c-817e-efe5c506d3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.658198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58313617-25e5-431c-817e-efe5c506d3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.667515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58313617-25e5-431c-817e-efe5c506d3b2 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.692715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 916/1827] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:08 2022] POST /identity/v3/users => generated 304 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:08.694352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7c9c5-4d24-49d3-a68d-b751cdbc1b91 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.704255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 912/1828] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:08.706837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313617-25e5-431c-817e-efe5c506d3b2 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.709763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7c9c5-4d24-49d3-a68d-b751cdbc1b91 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.717132 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39bd1-be76-4871-8faa-05732c1cd82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.717889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39bd1-be76-4871-8faa-05732c1cd82c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.718280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39bd1-be76-4871-8faa-05732c1cd82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.718662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39bd1-be76-4871-8faa-05732c1cd82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.719850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d39bd1-be76-4871-8faa-05732c1cd82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.722090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d39bd1-be76-4871-8faa-05732c1cd82c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.726571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58313617-25e5-431c-817e-efe5c506d3b2 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.734927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9d1cd-4eb3-465b-9079-7c8cc1e6c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.736161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9d1cd-4eb3-465b-9079-7c8cc1e6c456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.736719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9d1cd-4eb3-465b-9079-7c8cc1e6c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.737299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9d1cd-4eb3-465b-9079-7c8cc1e6c456 admin admin] PATH_INFO: `/v3/projects/d8f95b02899b4be5a54d30aafbbaa795/users/69ed540aa28a4c1c92534a35c166a77f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.741341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 917/1829] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:08.747548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39bd1-be76-4871-8faa-05732c1cd82c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.757969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39bd1-be76-4871-8faa-05732c1cd82c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.763483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74932d2e-9b3a-43cf-b29f-23c6559f66fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.764123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74932d2e-9b3a-43cf-b29f-23c6559f66fa admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.764404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74932d2e-9b3a-43cf-b29f-23c6559f66fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.764678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74932d2e-9b3a-43cf-b29f-23c6559f66fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.764819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9d1cd-4eb3-465b-9079-7c8cc1e6c456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f95b02899b4be5a54d30aafbbaa795, user_id=69ed540aa28a4c1c92534a35c166a77f, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.765415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74932d2e-9b3a-43cf-b29f-23c6559f66fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.767015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74932d2e-9b3a-43cf-b29f-23c6559f66fa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.767768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9d1cd-4eb3-465b-9079-7c8cc1e6c456 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.781547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 918/1830] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:08.787248 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74932d2e-9b3a-43cf-b29f-23c6559f66fa admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.798384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74932d2e-9b3a-43cf-b29f-23c6559f66fa admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:08.809738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20edb6-2da5-4fdc-97b7-8736da9b2ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:08.810983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20edb6-2da5-4fdc-97b7-8736da9b2ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.810983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20edb6-2da5-4fdc-97b7-8736da9b2ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.811720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20edb6-2da5-4fdc-97b7-8736da9b2ff0 admin admin] PATH_INFO: `/v3/projects/5a4bc5721a9641999e9c4b3f3a2ecced/users/93dab9c547ff44248ed0890d6a394495/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.844439 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20edb6-2da5-4fdc-97b7-8736da9b2ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4bc5721a9641999e9c4b3f3a2ecced, user_id=93dab9c547ff44248ed0890d6a394495, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:08.854679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 913/1831] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:08 2022] PUT /identity/v3/projects/d8f95b02899b4be5a54d30aafbbaa795/users/69ed540aa28a4c1c92534a35c166a77f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:08.855556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20edb6-2da5-4fdc-97b7-8736da9b2ff0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:08.868075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476b635-75d6-41b8-86a9-f55087d34ce2 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:08.868452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476b635-75d6-41b8-86a9-f55087d34ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:08.868734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476b635-75d6-41b8-86a9-f55087d34ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:08.898570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-4476b635-75d6-41b8-86a9-f55087d34ce2 None None] MFA Rules not processed for user `69ed540aa28a4c1c92534a35c166a77f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:08.899910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4476b635-75d6-41b8-86a9-f55087d34ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:08.969180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 919/1832] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:08 2022] PUT /identity/v3/projects/5a4bc5721a9641999e9c4b3f3a2ecced/users/93dab9c547ff44248ed0890d6a394495/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:08.972436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20edb6-2da5-4fdc-97b7-8736da9b2ff0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:08.978188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fc20edb6-2da5-4fdc-97b7-8736da9b2ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:09.004944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 914/1833] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:09.009593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5aea-8b3a-4611-b268-2701919ffe6f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:09.009898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5aea-8b3a-4611-b268-2701919ffe6f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:09.010941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5aea-8b3a-4611-b268-2701919ffe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:09.059115 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-bdff5aea-8b3a-4611-b268-2701919ffe6f None None] MFA Rules not processed for user `93dab9c547ff44248ed0890d6a394495`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:09.067854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bdff5aea-8b3a-4611-b268-2701919ffe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:09.101411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20edb6-2da5-4fdc-97b7-8736da9b2ff0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:09.109509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:09.110460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:09.111238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:09.111519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] PATH_INFO: `/v3/projects/b8e85e13be674543a54f5e4df2887abe` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:09.113261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e85e13be674543a54f5e4df2887abe)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:09.116565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:09.203476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 915/1834] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:09.204340 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5aea-8b3a-4611-b268-2701919ffe6f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:09.227559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5aea-8b3a-4611-b268-2701919ffe6f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:09.233758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb2af8-2cfd-41fc-8f62-4416d3a49438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:09.234327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb2af8-2cfd-41fc-8f62-4416d3a49438 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:09.234603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb2af8-2cfd-41fc-8f62-4416d3a49438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:09.234870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb2af8-2cfd-41fc-8f62-4416d3a49438 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:09.235542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb2af8-2cfd-41fc-8f62-4416d3a49438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:09.237498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb2af8-2cfd-41fc-8f62-4416d3a49438 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:09.873953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 916/1835] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:09 2022] POST /identity/v3/projects => generated 383 bytes in 668 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:09.878458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb2af8-2cfd-41fc-8f62-4416d3a49438 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:09.917702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e85e13be674543a54f5e4df2887abe', 'request_id': 'req-1b02e578-9abd-47f3-969a-d35df3333a06'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.013777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb2af8-2cfd-41fc-8f62-4416d3a49438 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:10.019880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d09b6-2eec-4dfb-863e-1cb816fb1167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:10.020363 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d09b6-2eec-4dfb-863e-1cb816fb1167 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:10.020648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d09b6-2eec-4dfb-863e-1cb816fb1167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:10.021024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d09b6-2eec-4dfb-863e-1cb816fb1167 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:10.021771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d09b6-2eec-4dfb-863e-1cb816fb1167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:10.023799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d09b6-2eec-4dfb-863e-1cb816fb1167 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:10.087446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e85e13be674543a54f5e4df2887abe', 'request_id': 'req-1b02e578-9abd-47f3-969a-d35df3333a06'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.096542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e85e13be674543a54f5e4df2887abe', 'request_id': 'req-1b02e578-9abd-47f3-969a-d35df3333a06'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.129764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] The token cache is being invalidate because project b8e85e13be674543a54f5e4df2887abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:10.130035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.132864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.135899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 920/1836] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:08 2022] DELETE /identity/v3/projects/b8e85e13be674543a54f5e4df2887abe => generated 0 bytes in 1164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:10.137007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:10.139855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:10.160862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 917/1837] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:09 2022] POST /identity/v3/projects => generated 409 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:10.166978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1374e0-088b-413c-aa3b-7f7baac7ceb1 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:10.166978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1374e0-088b-413c-aa3b-7f7baac7ceb1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:10.166978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1374e0-088b-413c-aa3b-7f7baac7ceb1 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:10.166978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 918/1838] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:09:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:09:10.168114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1374e0-088b-413c-aa3b-7f7baac7ceb1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:10.170513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7f1374e0-088b-413c-aa3b-7f7baac7ceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:10.248475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e578-9abd-47f3-969a-d35df3333a06 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:10.275458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1374e0-088b-413c-aa3b-7f7baac7ceb1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:10.282532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:10.283722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:10.284302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:10.284721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] PATH_INFO: `/v3/users/f3af17559af04b71bfeb4178ee841514` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:10.288147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3af17559af04b71bfeb4178ee841514)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:10.291930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:10.329754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51fe71-732b-4868-adfa-d95bbece136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:10.330379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51fe71-732b-4868-adfa-d95bbece136d admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:10.330657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51fe71-732b-4868-adfa-d95bbece136d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:10.330924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51fe71-732b-4868-adfa-d95bbece136d admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:10.331594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51fe71-732b-4868-adfa-d95bbece136d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:10.334830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51fe71-732b-4868-adfa-d95bbece136d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:10.470767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 921/1839] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:10 2022] POST /identity/v3/users => generated 298 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:10.477159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51fe71-732b-4868-adfa-d95bbece136d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:10.479084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7b51fe71-732b-4868-adfa-d95bbece136d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:10.493463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:10.501220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51fe71-732b-4868-adfa-d95bbece136d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:10.510559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b37e2-1d4c-4ec1-b9b8-08ccad200f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:10.511039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b37e2-1d4c-4ec1-b9b8-08ccad200f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:10.511381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b37e2-1d4c-4ec1-b9b8-08ccad200f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:10.511737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b37e2-1d4c-4ec1-b9b8-08ccad200f21 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:10.512405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b37e2-1d4c-4ec1-b9b8-08ccad200f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:10.514536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b37e2-1d4c-4ec1-b9b8-08ccad200f21 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:10.596066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3af17559af04b71bfeb4178ee841514'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.596818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3af17559af04b71bfeb4178ee841514'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.616367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 922/1840] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:10 2022] POST /identity/v3/users => generated 311 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:10.620604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cc647-1945-4cc5-a7c3-98b6ac05c271 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:10.620931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cc647-1945-4cc5-a7c3-98b6ac05c271 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:10.621211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cc647-1945-4cc5-a7c3-98b6ac05c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:10.656302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c70cc647-1945-4cc5-a7c3-98b6ac05c271 None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:10.658899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c70cc647-1945-4cc5-a7c3-98b6ac05c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:10.711675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3af17559af04b71bfeb4178ee841514'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.715199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3af17559af04b71bfeb4178ee841514'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.733119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3af17559af04b71bfeb4178ee841514'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:10.757972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 919/1841] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:10 2022] DELETE /identity/v3/users/f3af17559af04b71bfeb4178ee841514 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:10.759413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:10.769801 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:10.773842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 923/1842] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:09:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:10.774495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cc647-1945-4cc5-a7c3-98b6ac05c271 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:10.776043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c70cc647-1945-4cc5-a7c3-98b6ac05c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:10.792857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cc647-1945-4cc5-a7c3-98b6ac05c271 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:10.869345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119bcc8-8267-4b0c-8a57-0b0ea529df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:10.870446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119bcc8-8267-4b0c-8a57-0b0ea529df02 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:10.871014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119bcc8-8267-4b0c-8a57-0b0ea529df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:10.871298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119bcc8-8267-4b0c-8a57-0b0ea529df02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:10.872951 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119bcc8-8267-4b0c-8a57-0b0ea529df02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:10.875270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119bcc8-8267-4b0c-8a57-0b0ea529df02 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:10.876876 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af693e17-332e-4675-b136-09783fc7d2bb admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:10.887983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ad9a-7977-4287-8eb8-0186e521bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:10.890162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ad9a-7977-4287-8eb8-0186e521bdce admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:10.890602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ad9a-7977-4287-8eb8-0186e521bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:10.891049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ad9a-7977-4287-8eb8-0186e521bdce admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:10.897657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97ad9a-7977-4287-8eb8-0186e521bdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:10.900480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97ad9a-7977-4287-8eb8-0186e521bdce admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:10.900969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 924/1843] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:10.902548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119bcc8-8267-4b0c-8a57-0b0ea529df02 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:10.907047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2119bcc8-8267-4b0c-8a57-0b0ea529df02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:10.919845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 920/1844] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:10.920546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ad9a-7977-4287-8eb8-0186e521bdce admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:10.935682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ad9a-7977-4287-8eb8-0186e521bdce admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:10.946272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f94a8f-ff7e-47d7-bd5c-9ed112459098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:10.947902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f94a8f-ff7e-47d7-bd5c-9ed112459098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:10.947902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f94a8f-ff7e-47d7-bd5c-9ed112459098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:10.947902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f94a8f-ff7e-47d7-bd5c-9ed112459098 admin admin] PATH_INFO: `/v3/projects/718a80d33eb544cba25905ebf07a2718/users/9aa1040225204488abf5825d98ed6e1a/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:10.968546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f94a8f-ff7e-47d7-bd5c-9ed112459098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718a80d33eb544cba25905ebf07a2718, user_id=9aa1040225204488abf5825d98ed6e1a, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:10.971712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f94a8f-ff7e-47d7-bd5c-9ed112459098 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:11.057182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119bcc8-8267-4b0c-8a57-0b0ea529df02 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:11.071934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 921/1845] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:10 2022] PUT /identity/v3/projects/718a80d33eb544cba25905ebf07a2718/users/9aa1040225204488abf5825d98ed6e1a/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:11.071934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f94a8f-ff7e-47d7-bd5c-9ed112459098 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:11.072565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13521f-9226-4fb4-acec-c31a5cdc0aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:11.072565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13521f-9226-4fb4-acec-c31a5cdc0aa4 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:11.072565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13521f-9226-4fb4-acec-c31a5cdc0aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:11.073837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13521f-9226-4fb4-acec-c31a5cdc0aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:11.097463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13521f-9226-4fb4-acec-c31a5cdc0aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:11.099447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13521f-9226-4fb4-acec-c31a5cdc0aa4 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:11.128628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 925/1846] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:11.153331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13521f-9226-4fb4-acec-c31a5cdc0aa4 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:11.190971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13521f-9226-4fb4-acec-c31a5cdc0aa4 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:11.315147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f94a8f-ff7e-47d7-bd5c-9ed112459098 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:11.322551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79107d7-03d9-4968-b8a8-a7f6bac27930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:11.361404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79107d7-03d9-4968-b8a8-a7f6bac27930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:11.361404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79107d7-03d9-4968-b8a8-a7f6bac27930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:11.361404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79107d7-03d9-4968-b8a8-a7f6bac27930 admin admin] PATH_INFO: `/v3/projects/ab8b2054214e4e9e9c512cf0618d6e5a/users/f48265ae0c5e48999faf6812582716f4/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:11.367039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4642-86c3-4787-a9c6-d289129cd1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:11.367691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4642-86c3-4787-a9c6-d289129cd1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:11.367977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4642-86c3-4787-a9c6-d289129cd1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:11.368257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4642-86c3-4787-a9c6-d289129cd1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:11.369009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d4642-86c3-4787-a9c6-d289129cd1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:11.370697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d4642-86c3-4787-a9c6-d289129cd1f7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:11.386679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79107d7-03d9-4968-b8a8-a7f6bac27930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8b2054214e4e9e9c512cf0618d6e5a, user_id=f48265ae0c5e48999faf6812582716f4, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:11.396939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79107d7-03d9-4968-b8a8-a7f6bac27930 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:11.397084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 926/1847] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:11.399479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4642-86c3-4787-a9c6-d289129cd1f7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:11.420980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4642-86c3-4787-a9c6-d289129cd1f7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:11.438215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0080ca-7977-4681-87e1-10cd84878053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:11.438920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0080ca-7977-4681-87e1-10cd84878053 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:11.439204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0080ca-7977-4681-87e1-10cd84878053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:11.439484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0080ca-7977-4681-87e1-10cd84878053 admin admin] PATH_INFO: `/v3/projects/718a80d33eb544cba25905ebf07a2718/users/9aa1040225204488abf5825d98ed6e1a/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:11.443276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0080ca-7977-4681-87e1-10cd84878053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718a80d33eb544cba25905ebf07a2718, user_id=9aa1040225204488abf5825d98ed6e1a, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:11.446041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0080ca-7977-4681-87e1-10cd84878053 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:11.482127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 927/1848] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:11 2022] PUT /identity/v3/projects/718a80d33eb544cba25905ebf07a2718/users/9aa1040225204488abf5825d98ed6e1a/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:11.490997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c998609-dd45-400d-aad7-8aa7c30dabfb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:11.491302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c998609-dd45-400d-aad7-8aa7c30dabfb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:11.491585 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c998609-dd45-400d-aad7-8aa7c30dabfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:11.508177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 922/1849] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:11 2022] PUT /identity/v3/projects/ab8b2054214e4e9e9c512cf0618d6e5a/users/f48265ae0c5e48999faf6812582716f4/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:11.519116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79107d7-03d9-4968-b8a8-a7f6bac27930 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:11.536438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5c998609-dd45-400d-aad7-8aa7c30dabfb None None] MFA Rules not processed for user `9aa1040225204488abf5825d98ed6e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:11.538564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5c998609-dd45-400d-aad7-8aa7c30dabfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:11.663721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 928/1850] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:11 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:11.675981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c998609-dd45-400d-aad7-8aa7c30dabfb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:11.679077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5c998609-dd45-400d-aad7-8aa7c30dabfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:11.694006 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79107d7-03d9-4968-b8a8-a7f6bac27930 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:11.719930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1818e8-940e-4338-8acc-851c7f6a2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:11.721503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1818e8-940e-4338-8acc-851c7f6a2731 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:11.721503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1818e8-940e-4338-8acc-851c7f6a2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:11.726379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1818e8-940e-4338-8acc-851c7f6a2731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:11.726666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1818e8-940e-4338-8acc-851c7f6a2731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:11.728516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1818e8-940e-4338-8acc-851c7f6a2731 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:11.760121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 923/1851] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:11.760121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1818e8-940e-4338-8acc-851c7f6a2731 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:11.773916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1818e8-940e-4338-8acc-851c7f6a2731 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:11.793650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ae7b6-2eb3-4f8b-9c3a-36af08ff41f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:11.797312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ae7b6-2eb3-4f8b-9c3a-36af08ff41f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:11.802664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ae7b6-2eb3-4f8b-9c3a-36af08ff41f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:11.803122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ae7b6-2eb3-4f8b-9c3a-36af08ff41f2 admin admin] PATH_INFO: `/v3/projects/ab8b2054214e4e9e9c512cf0618d6e5a/users/f48265ae0c5e48999faf6812582716f4/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:11.808278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ae7b6-2eb3-4f8b-9c3a-36af08ff41f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8b2054214e4e9e9c512cf0618d6e5a, user_id=f48265ae0c5e48999faf6812582716f4, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:11.810886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ae7b6-2eb3-4f8b-9c3a-36af08ff41f2 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:11.825412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c998609-dd45-400d-aad7-8aa7c30dabfb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:11.845022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 924/1852] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:11 2022] PUT /identity/v3/projects/ab8b2054214e4e9e9c512cf0618d6e5a/users/f48265ae0c5e48999faf6812582716f4/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:11.845022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ae7b6-2eb3-4f8b-9c3a-36af08ff41f2 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:11.848945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-905ae7b6-2eb3-4f8b-9c3a-36af08ff41f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:11.890602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:11.903967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc0446-05af-4b29-ab05-84aa519d57d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:11.904602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc0446-05af-4b29-ab05-84aa519d57d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:11.904916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc0446-05af-4b29-ab05-84aa519d57d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:11.905478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc0446-05af-4b29-ab05-84aa519d57d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:11.951084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ae7b6-2eb3-4f8b-9c3a-36af08ff41f2 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:11.963931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:11.964626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:11.964946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:11.965228 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] PATH_INFO: `/v3/projects/68f3a4cca93740f4a88aca32ec16ed1b` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:11.970229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f3a4cca93740f4a88aca32ec16ed1b)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:11.974714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:11.997920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc0446-05af-4b29-ab05-84aa519d57d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:12.001021 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc0446-05af-4b29-ab05-84aa519d57d5 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:12.014879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 929/1853] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:11 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:12.017912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab71f-07bf-4f67-ac13-d407f34c911a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.024890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab71f-07bf-4f67-ac13-d407f34c911a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.024890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab71f-07bf-4f67-ac13-d407f34c911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.116011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-35dab71f-07bf-4f67-ac13-d407f34c911a None None] MFA Rules not processed for user `f48265ae0c5e48999faf6812582716f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:12.118050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-35dab71f-07bf-4f67-ac13-d407f34c911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:12.191026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f3a4cca93740f4a88aca32ec16ed1b', 'request_id': 'req-c0b72b0f-883e-4005-90c6-39bc961ffddb'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:12.197940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f3a4cca93740f4a88aca32ec16ed1b', 'request_id': 'req-c0b72b0f-883e-4005-90c6-39bc961ffddb'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:12.306081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 930/1854] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:12.307480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010b6bd-537d-42ba-adc1-d7b4eaa0c608 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.307898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010b6bd-537d-42ba-adc1-d7b4eaa0c608 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.309183 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010b6bd-537d-42ba-adc1-d7b4eaa0c608 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.310805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 931/1855] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:09:12.316038 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f3a4cca93740f4a88aca32ec16ed1b', 'request_id': 'req-c0b72b0f-883e-4005-90c6-39bc961ffddb'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:12.331377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af9461-30c3-4353-8b36-0ee87b314923 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.331741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af9461-30c3-4353-8b36-0ee87b314923 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.333230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af9461-30c3-4353-8b36-0ee87b314923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.342944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] The token cache is being invalidate because project 68f3a4cca93740f4a88aca32ec16ed1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:12.343441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:12.346227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c0b72b0f-883e-4005-90c6-39bc961ffddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:12.351111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 925/1856] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:11 2022] DELETE /identity/v3/projects/68f3a4cca93740f4a88aca32ec16ed1b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:12.354905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1f74b-f043-4a6a-99c8-04b67d0c1fb6 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.355295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1f74b-f043-4a6a-99c8-04b67d0c1fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.355639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1f74b-f043-4a6a-99c8-04b67d0c1fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.368188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e9af9461-30c3-4353-8b36-0ee87b314923 None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:12.370494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e9af9461-30c3-4353-8b36-0ee87b314923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:12.378241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8db1f74b-f043-4a6a-99c8-04b67d0c1fb6 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:12.379520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8db1f74b-f043-4a6a-99c8-04b67d0c1fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:12.472617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 932/1857] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:09:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:12.473792 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af9461-30c3-4353-8b36-0ee87b314923 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:12.479307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e9af9461-30c3-4353-8b36-0ee87b314923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:12.484823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 926/1858] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:12.491550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717501da-75a7-4daf-80bf-1c67c5ef60d6 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.492067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717501da-75a7-4daf-80bf-1c67c5ef60d6 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.492629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717501da-75a7-4daf-80bf-1c67c5ef60d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.516737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-717501da-75a7-4daf-80bf-1c67c5ef60d6 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:12.518385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-717501da-75a7-4daf-80bf-1c67c5ef60d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:12.534702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 927/1859] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:12.535724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717501da-75a7-4daf-80bf-1c67c5ef60d6 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:12.537745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-717501da-75a7-4daf-80bf-1c67c5ef60d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:12.556689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717501da-75a7-4daf-80bf-1c67c5ef60d6 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:12.557449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af9461-30c3-4353-8b36-0ee87b314923 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:12.561653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861447c7-6872-40b3-8a6a-e97edd2b9410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:12.562444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861447c7-6872-40b3-8a6a-e97edd2b9410 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.562879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861447c7-6872-40b3-8a6a-e97edd2b9410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.563092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8a9d2-4cc0-472c-8c42-ac001d9989b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:12.563466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861447c7-6872-40b3-8a6a-e97edd2b9410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.563713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8a9d2-4cc0-472c-8c42-ac001d9989b9 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.564041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8a9d2-4cc0-472c-8c42-ac001d9989b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.564320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8a9d2-4cc0-472c-8c42-ac001d9989b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.565760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-861447c7-6872-40b3-8a6a-e97edd2b9410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:12.574244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8a9d2-4cc0-472c-8c42-ac001d9989b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:12.575828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8a9d2-4cc0-472c-8c42-ac001d9989b9 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:12.598540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 928/1860] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:12.605854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8a9d2-4cc0-472c-8c42-ac001d9989b9 service nova] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:12.620731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8a9d2-4cc0-472c-8c42-ac001d9989b9 service nova] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:12.644438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076280d-ffba-41d4-a30e-f9a76bd81fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:12.645583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076280d-ffba-41d4-a30e-f9a76bd81fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.646954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861447c7-6872-40b3-8a6a-e97edd2b9410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:12.647555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076280d-ffba-41d4-a30e-f9a76bd81fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.647838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076280d-ffba-41d4-a30e-f9a76bd81fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.648866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076280d-ffba-41d4-a30e-f9a76bd81fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:12.649173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076280d-ffba-41d4-a30e-f9a76bd81fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:12.649482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861447c7-6872-40b3-8a6a-e97edd2b9410 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:12.650815 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076280d-ffba-41d4-a30e-f9a76bd81fd2 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:12.660977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 933/1861] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:12.679321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 929/1862] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:09:12.680896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861447c7-6872-40b3-8a6a-e97edd2b9410 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:12.704291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861447c7-6872-40b3-8a6a-e97edd2b9410 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:12.717504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504be20-4802-4860-855d-8dfe79cf8fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:12.721291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504be20-4802-4860-855d-8dfe79cf8fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.721291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504be20-4802-4860-855d-8dfe79cf8fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.721291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504be20-4802-4860-855d-8dfe79cf8fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.721291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504be20-4802-4860-855d-8dfe79cf8fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:12.721907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504be20-4802-4860-855d-8dfe79cf8fa3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:12.782204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076280d-ffba-41d4-a30e-f9a76bd81fd2 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:12.791898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076280d-ffba-41d4-a30e-f9a76bd81fd2 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:12.796497 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c183f-4230-4009-9cba-ffc108e6b715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:12.797547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c183f-4230-4009-9cba-ffc108e6b715 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.797547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c183f-4230-4009-9cba-ffc108e6b715 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.797784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c183f-4230-4009-9cba-ffc108e6b715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.799545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-550c183f-4230-4009-9cba-ffc108e6b715 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:12.828220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 934/1863] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:12 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:12.832684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504be20-4802-4860-855d-8dfe79cf8fa3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:12.906018 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c183f-4230-4009-9cba-ffc108e6b715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:12.908313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c183f-4230-4009-9cba-ffc108e6b715 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:12.921253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 930/1864] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:12.922028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504be20-4802-4860-855d-8dfe79cf8fa3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:12.927044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce25ea0-525e-4186-8c56-0a315d11734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:12.928231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce25ea0-525e-4186-8c56-0a315d11734d admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:12.928653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce25ea0-525e-4186-8c56-0a315d11734d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:12.929032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce25ea0-525e-4186-8c56-0a315d11734d admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:12.929733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce25ea0-525e-4186-8c56-0a315d11734d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:12.931751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce25ea0-525e-4186-8c56-0a315d11734d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:13.060748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 935/1865] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:12 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:13.060947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c183f-4230-4009-9cba-ffc108e6b715 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:13.074260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c183f-4230-4009-9cba-ffc108e6b715 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:13.088533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170067c7-857a-456d-848d-c96221e3264f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:13.096636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170067c7-857a-456d-848d-c96221e3264f admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:13.098061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170067c7-857a-456d-848d-c96221e3264f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:13.098366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170067c7-857a-456d-848d-c96221e3264f admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:13.099109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170067c7-857a-456d-848d-c96221e3264f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:13.103062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170067c7-857a-456d-848d-c96221e3264f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:13.131331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 931/1866] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:13.135798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce25ea0-525e-4186-8c56-0a315d11734d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:13.148719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce25ea0-525e-4186-8c56-0a315d11734d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:13.160408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5947008-2cf4-425e-a672-574f2482fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:13.161436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947008-2cf4-425e-a672-574f2482fad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:13.162059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947008-2cf4-425e-a672-574f2482fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:13.162576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947008-2cf4-425e-a672-574f2482fad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:13.163713 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5947008-2cf4-425e-a672-574f2482fad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:13.166105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5947008-2cf4-425e-a672-574f2482fad1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:13.179861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 936/1867] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:13.187288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170067c7-857a-456d-848d-c96221e3264f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:13.202452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170067c7-857a-456d-848d-c96221e3264f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:13.211407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecd6ae-fe01-43ff-ba81-3f13276b63bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:13.212162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecd6ae-fe01-43ff-ba81-3f13276b63bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:13.212500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecd6ae-fe01-43ff-ba81-3f13276b63bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:13.212802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecd6ae-fe01-43ff-ba81-3f13276b63bb admin admin] PATH_INFO: `/v3/projects/d62bb19328144c598c047262da10199d/users/9c9ff32ef8c14e5f839fe38817f43cc3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:13.241279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecd6ae-fe01-43ff-ba81-3f13276b63bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62bb19328144c598c047262da10199d, user_id=9c9ff32ef8c14e5f839fe38817f43cc3, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:13.245606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecd6ae-fe01-43ff-ba81-3f13276b63bb admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:13.390512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 932/1868] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:13 2022] PUT /identity/v3/projects/d62bb19328144c598c047262da10199d/users/9c9ff32ef8c14e5f839fe38817f43cc3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:13.393794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96f2e6-64fd-4758-8419-94565742f4ff None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:13.394202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96f2e6-64fd-4758-8419-94565742f4ff None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:13.394577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96f2e6-64fd-4758-8419-94565742f4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:13.437431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5e96f2e6-64fd-4758-8419-94565742f4ff None None] MFA Rules not processed for user `9c9ff32ef8c14e5f839fe38817f43cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:13.438778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5e96f2e6-64fd-4758-8419-94565742f4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:13.512764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 937/1869] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:13.517013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecd6ae-fe01-43ff-ba81-3f13276b63bb admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:13.588692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecd6ae-fe01-43ff-ba81-3f13276b63bb admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:13.594320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feebfd7-a7a2-4468-8892-acccb26c5446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:13.595187 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feebfd7-a7a2-4468-8892-acccb26c5446 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:13.595457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feebfd7-a7a2-4468-8892-acccb26c5446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:13.595731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feebfd7-a7a2-4468-8892-acccb26c5446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:13.596395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feebfd7-a7a2-4468-8892-acccb26c5446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:13.598579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feebfd7-a7a2-4468-8892-acccb26c5446 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:13.724026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 933/1870] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:13 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:13.728616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96f2e6-64fd-4758-8419-94565742f4ff None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:13.742188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96f2e6-64fd-4758-8419-94565742f4ff None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:13.832212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac46d0-9518-408d-93be-6f268bfecd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:13.832964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac46d0-9518-408d-93be-6f268bfecd8b admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:13.833316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac46d0-9518-408d-93be-6f268bfecd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:13.833706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac46d0-9518-408d-93be-6f268bfecd8b admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:13.834499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac46d0-9518-408d-93be-6f268bfecd8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:13.836801 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac46d0-9518-408d-93be-6f268bfecd8b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:13.931270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 938/1871] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:13 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:13.935151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feebfd7-a7a2-4468-8892-acccb26c5446 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:13.946029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feebfd7-a7a2-4468-8892-acccb26c5446 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:13.950697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff372f-8f71-4187-94fc-068a81fbfd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:13.951317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff372f-8f71-4187-94fc-068a81fbfd25 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:13.951608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff372f-8f71-4187-94fc-068a81fbfd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:13.951873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff372f-8f71-4187-94fc-068a81fbfd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:13.952587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff372f-8f71-4187-94fc-068a81fbfd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:13.954415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff372f-8f71-4187-94fc-068a81fbfd25 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:13.966184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 934/1872] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:13.971264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac46d0-9518-408d-93be-6f268bfecd8b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:13.982695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac46d0-9518-408d-93be-6f268bfecd8b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:13.987508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838aae8-6068-4f55-bf67-252adebe8167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:13.988189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838aae8-6068-4f55-bf67-252adebe8167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:13.988472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838aae8-6068-4f55-bf67-252adebe8167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:13.988980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838aae8-6068-4f55-bf67-252adebe8167 admin admin] PATH_INFO: `/v3/projects/fbdc111c93a34e398119baed8eb07e28/users/0807c1755dbd47a4818d7e4ffd6be134/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:14.006502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838aae8-6068-4f55-bf67-252adebe8167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdc111c93a34e398119baed8eb07e28, user_id=0807c1755dbd47a4818d7e4ffd6be134, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:14.009630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838aae8-6068-4f55-bf67-252adebe8167 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:14.164015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 939/1873] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:13 2022] PUT /identity/v3/projects/fbdc111c93a34e398119baed8eb07e28/users/0807c1755dbd47a4818d7e4ffd6be134/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:14.168138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff372f-8f71-4187-94fc-068a81fbfd25 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:14.178479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff372f-8f71-4187-94fc-068a81fbfd25 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:14.236478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133ae72-69ad-4aa1-acab-933bacb9fabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:14.237176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133ae72-69ad-4aa1-acab-933bacb9fabf admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:14.237450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133ae72-69ad-4aa1-acab-933bacb9fabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:14.237726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133ae72-69ad-4aa1-acab-933bacb9fabf admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:14.238607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133ae72-69ad-4aa1-acab-933bacb9fabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:14.240253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133ae72-69ad-4aa1-acab-933bacb9fabf admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:14.251198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 935/1874] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:14.257650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838aae8-6068-4f55-bf67-252adebe8167 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:14.265551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838aae8-6068-4f55-bf67-252adebe8167 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:14.270057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0be2a7-189d-4733-a4e4-65e411e122c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:14.270707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be2a7-189d-4733-a4e4-65e411e122c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:14.270985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be2a7-189d-4733-a4e4-65e411e122c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:14.271764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be2a7-189d-4733-a4e4-65e411e122c3 admin admin] PATH_INFO: `/v3/projects/fbdc111c93a34e398119baed8eb07e28/users/0807c1755dbd47a4818d7e4ffd6be134/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:14.273924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0be2a7-189d-4733-a4e4-65e411e122c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbdc111c93a34e398119baed8eb07e28, user_id=0807c1755dbd47a4818d7e4ffd6be134, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:14.280310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0be2a7-189d-4733-a4e4-65e411e122c3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:14.291863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 940/1875] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:14 2022] PUT /identity/v3/projects/fbdc111c93a34e398119baed8eb07e28/users/0807c1755dbd47a4818d7e4ffd6be134/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:14.304104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cd748-de35-4a2c-b123-be1a6c558c75 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:14.304333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cd748-de35-4a2c-b123-be1a6c558c75 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:14.304608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cd748-de35-4a2c-b123-be1a6c558c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:14.332321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-792cd748-de35-4a2c-b123-be1a6c558c75 None None] MFA Rules not processed for user `0807c1755dbd47a4818d7e4ffd6be134`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:14.333689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-792cd748-de35-4a2c-b123-be1a6c558c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:14.403238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 936/1876] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:14.415743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0be2a7-189d-4733-a4e4-65e411e122c3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:14.418776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7d0be2a7-189d-4733-a4e4-65e411e122c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:14.473788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0be2a7-189d-4733-a4e4-65e411e122c3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:14.477136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:14.477945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34292-df2c-426c-880b-3f4fa6c6dbc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:14.478552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34292-df2c-426c-880b-3f4fa6c6dbc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:14.478828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34292-df2c-426c-880b-3f4fa6c6dbc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:14.479094 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a34292-df2c-426c-880b-3f4fa6c6dbc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:14.533634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a34292-df2c-426c-880b-3f4fa6c6dbc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:14.535052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a34292-df2c-426c-880b-3f4fa6c6dbc2 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:14.544267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 941/1877] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:14.688592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:15.682773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:16.835855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:18.683425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:18.878604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cd748-de35-4a2c-b123-be1a6c558c75 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:18.902355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cd748-de35-4a2c-b123-be1a6c558c75 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:18.906523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606f199-2370-4397-89e4-708813778940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:18.907162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606f199-2370-4397-89e4-708813778940 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:18.907605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606f199-2370-4397-89e4-708813778940 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:18.907878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606f199-2370-4397-89e4-708813778940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:18.920709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606f199-2370-4397-89e4-708813778940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:18.922279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606f199-2370-4397-89e4-708813778940 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:18.932366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 937/1878] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:21.293555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34292-df2c-426c-880b-3f4fa6c6dbc2 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:21.303540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a34292-df2c-426c-880b-3f4fa6c6dbc2 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:21.308356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba48236-a02d-44b1-9b75-54e8925076d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:21.309016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba48236-a02d-44b1-9b75-54e8925076d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:21.309295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba48236-a02d-44b1-9b75-54e8925076d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:21.309754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba48236-a02d-44b1-9b75-54e8925076d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:21.311649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1ba48236-a02d-44b1-9b75-54e8925076d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:21.384027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba48236-a02d-44b1-9b75-54e8925076d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:21.385529 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba48236-a02d-44b1-9b75-54e8925076d4 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:21.402701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 942/1879] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:21.632304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:22.866127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:23.331921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606f199-2370-4397-89e4-708813778940 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:23.333546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d606f199-2370-4397-89e4-708813778940 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:23.466466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606f199-2370-4397-89e4-708813778940 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:23.472055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:23.472978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:23.473261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:23.473695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] PATH_INFO: `/v3/users/93dab9c547ff44248ed0890d6a394495` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:23.475782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93dab9c547ff44248ed0890d6a394495)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:23.477760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:23.749665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93dab9c547ff44248ed0890d6a394495'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:23.751987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93dab9c547ff44248ed0890d6a394495'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:23.762931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:23.826059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93dab9c547ff44248ed0890d6a394495'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:23.827009 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93dab9c547ff44248ed0890d6a394495'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:23.842443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93dab9c547ff44248ed0890d6a394495'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:23.856807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 938/1880] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:23 2022] DELETE /identity/v3/users/93dab9c547ff44248ed0890d6a394495 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:23.861663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9904-b0ad-406d-981b-6d0134d73ea3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:23.862540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9904-b0ad-406d-981b-6d0134d73ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:23.862628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9904-b0ad-406d-981b-6d0134d73ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:23.888310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-86de9904-b0ad-406d-981b-6d0134d73ea3 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:23.889604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-86de9904-b0ad-406d-981b-6d0134d73ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:23.960907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 943/1881] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:23.970839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:23.972291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:24.039513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea62ad-c582-4cd6-aaab-dc21eab9c536 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:24.043971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadab5cd-f5d6-498d-8b09-cda1d65a2cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:24.044712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadab5cd-f5d6-498d-8b09-cda1d65a2cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:24.045035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadab5cd-f5d6-498d-8b09-cda1d65a2cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:24.045311 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadab5cd-f5d6-498d-8b09-cda1d65a2cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:24.056150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadab5cd-f5d6-498d-8b09-cda1d65a2cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:24.057708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadab5cd-f5d6-498d-8b09-cda1d65a2cfb service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:24.069049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 939/1882] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:25.274536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9904-b0ad-406d-981b-6d0134d73ea3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:25.277855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-86de9904-b0ad-406d-981b-6d0134d73ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:25.300136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9904-b0ad-406d-981b-6d0134d73ea3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:25.305377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:25.306435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:25.306631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:25.306958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] PATH_INFO: `/v3/projects/5a4bc5721a9641999e9c4b3f3a2ecced` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:25.308088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4bc5721a9641999e9c4b3f3a2ecced)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:25.310036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:25.472134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4bc5721a9641999e9c4b3f3a2ecced', 'request_id': 'req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:25.562343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4bc5721a9641999e9c4b3f3a2ecced', 'request_id': 'req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:25.569296 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4bc5721a9641999e9c4b3f3a2ecced', 'request_id': 'req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:25.582666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] The token cache is being invalidate because project 5a4bc5721a9641999e9c4b3f3a2ecced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:25.582943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:25.583604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:25.588693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 944/1883] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:25 2022] DELETE /identity/v3/projects/5a4bc5721a9641999e9c4b3f3a2ecced => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:25.590106 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadab5cd-f5d6-498d-8b09-cda1d65a2cfb service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:25.603262 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadab5cd-f5d6-498d-8b09-cda1d65a2cfb service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:25.671230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:25.691061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:25.692023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:25.694845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:25.695143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] PATH_INFO: `/v3/users/9aa1040225204488abf5825d98ed6e1a` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:25.696513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa1040225204488abf5825d98ed6e1a)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:25.699146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:26.025032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa1040225204488abf5825d98ed6e1a'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:26.025739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa1040225204488abf5825d98ed6e1a'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:26.149247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa1040225204488abf5825d98ed6e1a'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:26.149960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa1040225204488abf5825d98ed6e1a'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:26.165076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0b6c9ed0-624a-4546-a94f-7b862deb0730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa1040225204488abf5825d98ed6e1a'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:26.183417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 940/1884] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:25 2022] DELETE /identity/v3/users/9aa1040225204488abf5825d98ed6e1a => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:26.250206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:26.781539 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:26.783566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:26.797476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b8512-71e6-4a76-9fd1-8c44a6dbb416 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:26.863715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:26.864368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:26.865170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:26.865450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] PATH_INFO: `/v3/projects/718a80d33eb544cba25905ebf07a2718` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:26.866668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=718a80d33eb544cba25905ebf07a2718)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:26.868841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:27.004775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718a80d33eb544cba25905ebf07a2718', 'request_id': 'req-e79d67df-5f87-4568-99ff-60d66b493db0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:27.110871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718a80d33eb544cba25905ebf07a2718', 'request_id': 'req-e79d67df-5f87-4568-99ff-60d66b493db0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:27.118656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718a80d33eb544cba25905ebf07a2718', 'request_id': 'req-e79d67df-5f87-4568-99ff-60d66b493db0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:27.132836 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] The token cache is being invalidate because project 718a80d33eb544cba25905ebf07a2718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:27.133292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:27.134114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e79d67df-5f87-4568-99ff-60d66b493db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:27.135830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 945/1885] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:26 2022] DELETE /identity/v3/projects/718a80d33eb544cba25905ebf07a2718 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:27.142544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0ac8-0b78-4bfc-8efb-9d1dc2df3471 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:27.143036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0ac8-0b78-4bfc-8efb-9d1dc2df3471 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:27.143112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0ac8-0b78-4bfc-8efb-9d1dc2df3471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:27.166568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c18e0ac8-0b78-4bfc-8efb-9d1dc2df3471 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:27.168024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c18e0ac8-0b78-4bfc-8efb-9d1dc2df3471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:27.230416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 941/1886] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:27.239418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea454907-341f-49d0-bc78-b1a1025568d7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:27.240698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea454907-341f-49d0-bc78-b1a1025568d7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:27.240698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea454907-341f-49d0-bc78-b1a1025568d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:27.261826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ea454907-341f-49d0-bc78-b1a1025568d7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:27.263420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ea454907-341f-49d0-bc78-b1a1025568d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:27.271935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 946/1887] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:27.276600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e0ac8-0b78-4bfc-8efb-9d1dc2df3471 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:27.288066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e0ac8-0b78-4bfc-8efb-9d1dc2df3471 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:27.292820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e504505-13c5-431b-bb24-57731b790b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:27.293428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e504505-13c5-431b-bb24-57731b790b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:27.293702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e504505-13c5-431b-bb24-57731b790b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:27.293975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e504505-13c5-431b-bb24-57731b790b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:27.294662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e504505-13c5-431b-bb24-57731b790b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:27.294955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e504505-13c5-431b-bb24-57731b790b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:27.296530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e504505-13c5-431b-bb24-57731b790b8a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:27.309263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 942/1888] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:09:27.313583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea454907-341f-49d0-bc78-b1a1025568d7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:27.323411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea454907-341f-49d0-bc78-b1a1025568d7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:27.328033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3272b-c501-4529-8389-347bb92d7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:27.328641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3272b-c501-4529-8389-347bb92d7871 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:27.328959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3272b-c501-4529-8389-347bb92d7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:27.329235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3272b-c501-4529-8389-347bb92d7871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:27.329910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3272b-c501-4529-8389-347bb92d7871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:27.332042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3272b-c501-4529-8389-347bb92d7871 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:27.470338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 947/1889] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:27 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:27.471457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e504505-13c5-431b-bb24-57731b790b8a admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:27.481843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e504505-13c5-431b-bb24-57731b790b8a admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:27.536452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1953985-67e5-46d3-adae-473cd5e0214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:27.537687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1953985-67e5-46d3-adae-473cd5e0214a admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:27.537965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1953985-67e5-46d3-adae-473cd5e0214a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:27.538241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1953985-67e5-46d3-adae-473cd5e0214a admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:27.538992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1953985-67e5-46d3-adae-473cd5e0214a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:27.540923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1953985-67e5-46d3-adae-473cd5e0214a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:27.651908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 943/1890] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:27 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:27.653267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3272b-c501-4529-8389-347bb92d7871 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:27.663978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3272b-c501-4529-8389-347bb92d7871 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:27.668555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caf9c7-de41-4997-a4ed-b2c6732a38d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:27.669278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caf9c7-de41-4997-a4ed-b2c6732a38d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:27.669551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caf9c7-de41-4997-a4ed-b2c6732a38d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:27.669849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caf9c7-de41-4997-a4ed-b2c6732a38d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:27.670688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caf9c7-de41-4997-a4ed-b2c6732a38d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:27.672265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caf9c7-de41-4997-a4ed-b2c6732a38d1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:27.682578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 948/1891] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:27.686718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1953985-67e5-46d3-adae-473cd5e0214a admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:27.696756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1953985-67e5-46d3-adae-473cd5e0214a admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:27.701393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a683753-6799-450b-b187-dfc443953c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:27.702002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683753-6799-450b-b187-dfc443953c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:27.702283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683753-6799-450b-b187-dfc443953c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:27.702560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683753-6799-450b-b187-dfc443953c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:27.703254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a683753-6799-450b-b187-dfc443953c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:27.704877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a683753-6799-450b-b187-dfc443953c8d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:27.721830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 944/1892] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:27.725489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caf9c7-de41-4997-a4ed-b2c6732a38d1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:27.735819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caf9c7-de41-4997-a4ed-b2c6732a38d1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:27.742646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d789c7-e37c-4127-b2a3-0bf3e902efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:27.743453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d789c7-e37c-4127-b2a3-0bf3e902efdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:27.743783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d789c7-e37c-4127-b2a3-0bf3e902efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:27.744116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d789c7-e37c-4127-b2a3-0bf3e902efdf admin admin] PATH_INFO: `/v3/projects/3a1b936d7c384f2fba40e0fdaaff9439/users/271bd1b667c44a0394039e088497cce2/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:27.775319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d789c7-e37c-4127-b2a3-0bf3e902efdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1b936d7c384f2fba40e0fdaaff9439, user_id=271bd1b667c44a0394039e088497cce2, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:27.778836 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d789c7-e37c-4127-b2a3-0bf3e902efdf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:27.859685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 949/1893] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:27 2022] PUT /identity/v3/projects/3a1b936d7c384f2fba40e0fdaaff9439/users/271bd1b667c44a0394039e088497cce2/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:27.874757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305059-05c8-43d0-9499-5553b4e8cd3e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:27.874947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305059-05c8-43d0-9499-5553b4e8cd3e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:27.875221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305059-05c8-43d0-9499-5553b4e8cd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:27.902540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-08305059-05c8-43d0-9499-5553b4e8cd3e None None] MFA Rules not processed for user `271bd1b667c44a0394039e088497cce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:27.903790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-08305059-05c8-43d0-9499-5553b4e8cd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:27.970551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 945/1894] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:27.976537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d789c7-e37c-4127-b2a3-0bf3e902efdf admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:28.039173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d789c7-e37c-4127-b2a3-0bf3e902efdf admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:28.043975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d8a22-aa25-4c66-a818-3297923a413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:28.044596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d8a22-aa25-4c66-a818-3297923a413a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:28.044964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d8a22-aa25-4c66-a818-3297923a413a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:28.045240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d8a22-aa25-4c66-a818-3297923a413a admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:28.045907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d8a22-aa25-4c66-a818-3297923a413a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:28.047881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d8a22-aa25-4c66-a818-3297923a413a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:28.142114 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 950/1895] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:27 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:28.156184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305059-05c8-43d0-9499-5553b4e8cd3e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:28.157949 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305059-05c8-43d0-9499-5553b4e8cd3e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:28.190028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:28.216471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51810470-4375-4752-933c-33d0e48ef94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:28.217126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51810470-4375-4752-933c-33d0e48ef94d admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:28.217415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51810470-4375-4752-933c-33d0e48ef94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:28.217692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51810470-4375-4752-933c-33d0e48ef94d admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:28.218354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51810470-4375-4752-933c-33d0e48ef94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:28.220278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51810470-4375-4752-933c-33d0e48ef94d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:28.269926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:28.340474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 946/1896] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:28 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:28.344505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d8a22-aa25-4c66-a818-3297923a413a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:28.355605 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d8a22-aa25-4c66-a818-3297923a413a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:28.360276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1adc03-b9b6-407a-8d96-286c323e08f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:28.360911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1adc03-b9b6-407a-8d96-286c323e08f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:28.361189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1adc03-b9b6-407a-8d96-286c323e08f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:28.361487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1adc03-b9b6-407a-8d96-286c323e08f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:28.362198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1adc03-b9b6-407a-8d96-286c323e08f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:28.363804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1adc03-b9b6-407a-8d96-286c323e08f1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:28.380217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 951/1897] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:28.384454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51810470-4375-4752-933c-33d0e48ef94d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:28.394646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51810470-4375-4752-933c-33d0e48ef94d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:28.400017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeadd6-4185-4144-a162-bb6a6813ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:28.400684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeadd6-4185-4144-a162-bb6a6813ddac admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:28.401041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeadd6-4185-4144-a162-bb6a6813ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:28.401320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeadd6-4185-4144-a162-bb6a6813ddac admin admin] PATH_INFO: `/v3/projects/758d7d408c174de3a03c75b92a6a8764/users/4f66fe794fa04c4389763d5e949992f8/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:28.418388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabeadd6-4185-4144-a162-bb6a6813ddac admin admin] RBAC: Authorizing `identity:create_grant(project_id=758d7d408c174de3a03c75b92a6a8764, user_id=4f66fe794fa04c4389763d5e949992f8, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:28.421249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabeadd6-4185-4144-a162-bb6a6813ddac admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:28.584378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 947/1898] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:28 2022] PUT /identity/v3/projects/758d7d408c174de3a03c75b92a6a8764/users/4f66fe794fa04c4389763d5e949992f8/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:28.585755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1adc03-b9b6-407a-8d96-286c323e08f1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:28.596298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1adc03-b9b6-407a-8d96-286c323e08f1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:28.655704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbceb5-ee88-4d06-b75a-08fdec7e97c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:28.656337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbceb5-ee88-4d06-b75a-08fdec7e97c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:28.656620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbceb5-ee88-4d06-b75a-08fdec7e97c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:28.656930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbceb5-ee88-4d06-b75a-08fdec7e97c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:28.657746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbceb5-ee88-4d06-b75a-08fdec7e97c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:28.668857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbceb5-ee88-4d06-b75a-08fdec7e97c2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:28.670505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 952/1899] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:28.674842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeadd6-4185-4144-a162-bb6a6813ddac admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:28.688042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeadd6-4185-4144-a162-bb6a6813ddac admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:28.692907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ec4da-4450-4265-bb3e-61b44d0f62aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:28.693575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ec4da-4450-4265-bb3e-61b44d0f62aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:28.693854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ec4da-4450-4265-bb3e-61b44d0f62aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:28.694129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ec4da-4450-4265-bb3e-61b44d0f62aa admin admin] PATH_INFO: `/v3/projects/758d7d408c174de3a03c75b92a6a8764/users/4f66fe794fa04c4389763d5e949992f8/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:28.696146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ec4da-4450-4265-bb3e-61b44d0f62aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=758d7d408c174de3a03c75b92a6a8764, user_id=4f66fe794fa04c4389763d5e949992f8, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:28.699002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ec4da-4450-4265-bb3e-61b44d0f62aa admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:28.709716 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 948/1900] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:28 2022] PUT /identity/v3/projects/758d7d408c174de3a03c75b92a6a8764/users/4f66fe794fa04c4389763d5e949992f8/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:28.720949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e211ce-9977-4735-a568-94796ce15ff6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:28.721249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e211ce-9977-4735-a568-94796ce15ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:28.721527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e211ce-9977-4735-a568-94796ce15ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:28.750091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-17e211ce-9977-4735-a568-94796ce15ff6 None None] MFA Rules not processed for user `4f66fe794fa04c4389763d5e949992f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:28.751307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-17e211ce-9977-4735-a568-94796ce15ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:28.819566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 953/1901] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:28.831665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ec4da-4450-4265-bb3e-61b44d0f62aa admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:28.832813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-540ec4da-4450-4265-bb3e-61b44d0f62aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:28.895324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ec4da-4450-4265-bb3e-61b44d0f62aa admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:28.899109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64467c97-e001-4928-93e0-55525da20d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:28.899785 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64467c97-e001-4928-93e0-55525da20d9d service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:28.900005 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64467c97-e001-4928-93e0-55525da20d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:28.900279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64467c97-e001-4928-93e0-55525da20d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:28.909456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64467c97-e001-4928-93e0-55525da20d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:28.911076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64467c97-e001-4928-93e0-55525da20d9d service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:28.921122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 949/1902] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:29.209282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e211ce-9977-4735-a568-94796ce15ff6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:29.210668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-17e211ce-9977-4735-a568-94796ce15ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:29.223826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e211ce-9977-4735-a568-94796ce15ff6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:29.227574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde1261-9bed-4f36-9c97-707d40272836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:29.228276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde1261-9bed-4f36-9c97-707d40272836 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:29.228671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde1261-9bed-4f36-9c97-707d40272836 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:29.229051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde1261-9bed-4f36-9c97-707d40272836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:29.230339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64467c97-e001-4928-93e0-55525da20d9d service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:29.232852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-64467c97-e001-4928-93e0-55525da20d9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:29.291253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde1261-9bed-4f36-9c97-707d40272836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:29.292915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde1261-9bed-4f36-9c97-707d40272836 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:29.303378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 954/1903] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:29.303565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64467c97-e001-4928-93e0-55525da20d9d service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:29.308382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:29.309054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:29.309366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:29.309608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] PATH_INFO: `/v3/users/69ed540aa28a4c1c92534a35c166a77f` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:29.310789 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ed540aa28a4c1c92534a35c166a77f)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:29.312746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:29.647369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ed540aa28a4c1c92534a35c166a77f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:29.648192 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ed540aa28a4c1c92534a35c166a77f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:29.733643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ed540aa28a4c1c92534a35c166a77f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:29.734937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ed540aa28a4c1c92534a35c166a77f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:29.749487 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ed540aa28a4c1c92534a35c166a77f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:29.767445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22ab2-54e2-4ff0-ac9c-68f928ce572b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:29.767733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22ab2-54e2-4ff0-ac9c-68f928ce572b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:29.768170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22ab2-54e2-4ff0-ac9c-68f928ce572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:29.771578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 950/1904] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:29 2022] DELETE /identity/v3/users/69ed540aa28a4c1c92534a35c166a77f => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:29.788925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7dd22ab2-54e2-4ff0-ac9c-68f928ce572b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:29.790151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7dd22ab2-54e2-4ff0-ac9c-68f928ce572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:29.851374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 955/1905] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:29.862523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:29.872931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:29.946616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55a89-3b6b-4e6f-a532-8c18a7eef885 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:29.950806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a8d9-0b2a-404f-b09e-c10a93039bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:29.951427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a8d9-0b2a-404f-b09e-c10a93039bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:29.951710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a8d9-0b2a-404f-b09e-c10a93039bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:29.951991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a8d9-0b2a-404f-b09e-c10a93039bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:29.962139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184a8d9-0b2a-404f-b09e-c10a93039bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:29.963611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184a8d9-0b2a-404f-b09e-c10a93039bc6 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:29.977824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 951/1906] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:30.380019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:30.482533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:30.525493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22ab2-54e2-4ff0-ac9c-68f928ce572b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:30.527230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7dd22ab2-54e2-4ff0-ac9c-68f928ce572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:30.576295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22ab2-54e2-4ff0-ac9c-68f928ce572b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:30.584702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:30.585410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:30.585693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:30.585973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] PATH_INFO: `/v3/projects/d8f95b02899b4be5a54d30aafbbaa795` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:30.589820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f95b02899b4be5a54d30aafbbaa795)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:30.589820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:30.726193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f95b02899b4be5a54d30aafbbaa795', 'request_id': 'req-4b0518d7-9a06-4681-a54d-72a772a78956'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:30.842070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f95b02899b4be5a54d30aafbbaa795', 'request_id': 'req-4b0518d7-9a06-4681-a54d-72a772a78956'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:30.848297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f95b02899b4be5a54d30aafbbaa795', 'request_id': 'req-4b0518d7-9a06-4681-a54d-72a772a78956'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:30.860537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] The token cache is being invalidate because project d8f95b02899b4be5a54d30aafbbaa795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:30.860862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:30.861584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:30.863206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 956/1907] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:30 2022] DELETE /identity/v3/projects/d8f95b02899b4be5a54d30aafbbaa795 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:30.867904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a8d9-0b2a-404f-b09e-c10a93039bc6 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:30.877721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a8d9-0b2a-404f-b09e-c10a93039bc6 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:30.940425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:30.941116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:30.941409 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:30.941682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] PATH_INFO: `/v3/users/f48265ae0c5e48999faf6812582716f4` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:30.943025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48265ae0c5e48999faf6812582716f4)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:30.945045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:31.216724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48265ae0c5e48999faf6812582716f4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:31.217434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48265ae0c5e48999faf6812582716f4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:31.328685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48265ae0c5e48999faf6812582716f4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:31.330995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48265ae0c5e48999faf6812582716f4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:31.345963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48265ae0c5e48999faf6812582716f4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:31.359208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 952/1908] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:30 2022] DELETE /identity/v3/users/f48265ae0c5e48999faf6812582716f4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:31.810337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:31.811796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:31.837363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0518d7-9a06-4681-a54d-72a772a78956 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:31.895647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:31.896317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:31.896607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:31.896911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] PATH_INFO: `/v3/projects/ab8b2054214e4e9e9c512cf0618d6e5a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:31.898077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8b2054214e4e9e9c512cf0618d6e5a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:31.899976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:31.987668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:31.989151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:32.002358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab2bb5-e9a6-4257-b9e7-1f277e285f95 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:32.006991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:32.007611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.007890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.008722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] PATH_INFO: `/v3/users/c39e9c35eb904c95a08fb382b625eb91` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.009382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39e9c35eb904c95a08fb382b625eb91)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:32.011285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:32.057388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8b2054214e4e9e9c512cf0618d6e5a', 'request_id': 'req-1e805df6-3da2-4779-862a-e33ba38847c1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.121886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8b2054214e4e9e9c512cf0618d6e5a', 'request_id': 'req-1e805df6-3da2-4779-862a-e33ba38847c1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.128206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8b2054214e4e9e9c512cf0618d6e5a', 'request_id': 'req-1e805df6-3da2-4779-862a-e33ba38847c1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.139660 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] The token cache is being invalidate because project ab8b2054214e4e9e9c512cf0618d6e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:32.139950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.140619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1e805df6-3da2-4779-862a-e33ba38847c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.142190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 957/1909] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:31 2022] DELETE /identity/v3/projects/ab8b2054214e4e9e9c512cf0618d6e5a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:32.148884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92215b6-7bd4-410f-8032-b01fbfbc174d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.149275 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92215b6-7bd4-410f-8032-b01fbfbc174d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.149569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92215b6-7bd4-410f-8032-b01fbfbc174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.174866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c92215b6-7bd4-410f-8032-b01fbfbc174d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:32.176242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c92215b6-7bd4-410f-8032-b01fbfbc174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:32.195680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39e9c35eb904c95a08fb382b625eb91'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.196870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39e9c35eb904c95a08fb382b625eb91'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.200111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:32.246738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 958/1910] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:32.248464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0410-d206-4a8d-922b-6fa02984a485 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.248616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0410-d206-4a8d-922b-6fa02984a485 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.248831 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0410-d206-4a8d-922b-6fa02984a485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.269077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-222c0410-d206-4a8d-922b-6fa02984a485 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:32.270371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-222c0410-d206-4a8d-922b-6fa02984a485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:32.276731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39e9c35eb904c95a08fb382b625eb91'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.277499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39e9c35eb904c95a08fb382b625eb91'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.279166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 959/1911] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:32.290338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c0410-d206-4a8d-922b-6fa02984a485 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:32.299554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c0410-d206-4a8d-922b-6fa02984a485 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:32.304582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f89642c-5268-47c8-88cb-9d82f9c486a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39e9c35eb904c95a08fb382b625eb91'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:32.305973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:32.306786 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.307100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.307552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.308354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:32.308751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:32.310440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:32.322523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 953/1912] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:31 2022] DELETE /identity/v3/users/c39e9c35eb904c95a08fb382b625eb91 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:32.323646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1dad5-6200-4506-bbb7-77e5bd6f3686 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.324094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1dad5-6200-4506-bbb7-77e5bd6f3686 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.327643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 960/1913] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:09:32.327732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1dad5-6200-4506-bbb7-77e5bd6f3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.328614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:32.330586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:32.345214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1026eaa-ab4a-47a3-acb3-43b3e5d45780 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:32.357961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c9b1dad5-6200-4506-bbb7-77e5bd6f3686 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:32.359475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c9b1dad5-6200-4506-bbb7-77e5bd6f3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:32.413563 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c96e5d-c3b3-41f7-a8f5-298aa6763163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:32.414199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c96e5d-c3b3-41f7-a8f5-298aa6763163 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.414479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c96e5d-c3b3-41f7-a8f5-298aa6763163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.414856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c96e5d-c3b3-41f7-a8f5-298aa6763163 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.415500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c96e5d-c3b3-41f7-a8f5-298aa6763163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:32.417644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c96e5d-c3b3-41f7-a8f5-298aa6763163 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:32.444111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 954/1914] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:32.457652 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1dad5-6200-4506-bbb7-77e5bd6f3686 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:32.459229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c9b1dad5-6200-4506-bbb7-77e5bd6f3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:32.518096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 961/1915] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:32 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:32.519547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c96e5d-c3b3-41f7-a8f5-298aa6763163 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:32.528310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1dad5-6200-4506-bbb7-77e5bd6f3686 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:32.588358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c96e5d-c3b3-41f7-a8f5-298aa6763163 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:32.597507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab276639-e722-4036-9d36-17914871810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:32.598137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276639-e722-4036-9d36-17914871810e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.598422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276639-e722-4036-9d36-17914871810e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.598697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276639-e722-4036-9d36-17914871810e admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.599404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab276639-e722-4036-9d36-17914871810e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:32.601361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab276639-e722-4036-9d36-17914871810e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:32.605871 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35a2ac-522f-4fa7-84bb-bec8ded937fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:32.607368 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35a2ac-522f-4fa7-84bb-bec8ded937fb service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.607505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35a2ac-522f-4fa7-84bb-bec8ded937fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.607839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35a2ac-522f-4fa7-84bb-bec8ded937fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.622243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35a2ac-522f-4fa7-84bb-bec8ded937fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:32.623912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35a2ac-522f-4fa7-84bb-bec8ded937fb service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:32.638285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 955/1916] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:32.723539 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 962/1917] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:32 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:32.725695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35a2ac-522f-4fa7-84bb-bec8ded937fb service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:32.740431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35a2ac-522f-4fa7-84bb-bec8ded937fb service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:32.749058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627a822-1f47-41e8-8217-3c4a9047dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:32.749680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627a822-1f47-41e8-8217-3c4a9047dd25 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.749960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627a822-1f47-41e8-8217-3c4a9047dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.750292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627a822-1f47-41e8-8217-3c4a9047dd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.751016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627a822-1f47-41e8-8217-3c4a9047dd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:32.752610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627a822-1f47-41e8-8217-3c4a9047dd25 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:32.766696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 956/1918] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:32.768219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab276639-e722-4036-9d36-17914871810e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:32.786263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab276639-e722-4036-9d36-17914871810e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:32.793093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77421e-6a8a-46cc-aaec-ecace1ff45db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:32.794091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77421e-6a8a-46cc-aaec-ecace1ff45db admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.794447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77421e-6a8a-46cc-aaec-ecace1ff45db admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.795485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77421e-6a8a-46cc-aaec-ecace1ff45db admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.795485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77421e-6a8a-46cc-aaec-ecace1ff45db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:32.798148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77421e-6a8a-46cc-aaec-ecace1ff45db admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:32.808828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 963/1919] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:32.812971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627a822-1f47-41e8-8217-3c4a9047dd25 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:32.827712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627a822-1f47-41e8-8217-3c4a9047dd25 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:32.832427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e268-95da-44a5-bbee-e64f12b910c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:32.833129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e268-95da-44a5-bbee-e64f12b910c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:32.833955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e268-95da-44a5-bbee-e64f12b910c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:32.834214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e268-95da-44a5-bbee-e64f12b910c3 admin admin] PATH_INFO: `/v3/projects/179312b681af4d80ae60af658c10b94b/users/94aea7b379a246258eee7bf4f220e289/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:32.851529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e268-95da-44a5-bbee-e64f12b910c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179312b681af4d80ae60af658c10b94b, user_id=94aea7b379a246258eee7bf4f220e289, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:32.854213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e268-95da-44a5-bbee-e64f12b910c3 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:32.995759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 957/1920] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:32 2022] PUT /identity/v3/projects/179312b681af4d80ae60af658c10b94b/users/94aea7b379a246258eee7bf4f220e289/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:33.008415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80100-1813-4aea-9b59-17fe91fd7354 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:33.008931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80100-1813-4aea-9b59-17fe91fd7354 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:33.009048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80100-1813-4aea-9b59-17fe91fd7354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:33.040221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-daa80100-1813-4aea-9b59-17fe91fd7354 None None] MFA Rules not processed for user `94aea7b379a246258eee7bf4f220e289`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:33.041817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-daa80100-1813-4aea-9b59-17fe91fd7354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:33.113029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 964/1921] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:33.123550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e268-95da-44a5-bbee-e64f12b910c3 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:33.125762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-15d2e268-95da-44a5-bbee-e64f12b910c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:33.173901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa80100-1813-4aea-9b59-17fe91fd7354 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:33.175403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-daa80100-1813-4aea-9b59-17fe91fd7354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:33.224893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e268-95da-44a5-bbee-e64f12b910c3 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:33.230581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:33.231532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:33.233528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:33.234175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] PATH_INFO: `/v3/projects/43dbeeee7d90435e9af46f3098ab25c2` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:33.237974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=43dbeeee7d90435e9af46f3098ab25c2)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:33.239581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:33.241986 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:33.245220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa80100-1813-4aea-9b59-17fe91fd7354 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:33.250313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ad12-4200-40a8-9484-6d3403510232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:33.253123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ad12-4200-40a8-9484-6d3403510232 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:33.253123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ad12-4200-40a8-9484-6d3403510232 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:33.253123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ad12-4200-40a8-9484-6d3403510232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:33.262047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8ad12-4200-40a8-9484-6d3403510232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:33.263543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8ad12-4200-40a8-9484-6d3403510232 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:33.277399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 965/1922] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:33.297478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ad12-4200-40a8-9484-6d3403510232 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:33.308767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ad12-4200-40a8-9484-6d3403510232 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:33.313365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:33.313990 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:33.327513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:33.327513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] PATH_INFO: `/v3/users/94aea7b379a246258eee7bf4f220e289` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:33.327513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94aea7b379a246258eee7bf4f220e289)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:33.327513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:33.529270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94aea7b379a246258eee7bf4f220e289'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.529999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94aea7b379a246258eee7bf4f220e289'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.530114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43dbeeee7d90435e9af46f3098ab25c2', 'request_id': 'req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.536148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43dbeeee7d90435e9af46f3098ab25c2', 'request_id': 'req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.537760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94aea7b379a246258eee7bf4f220e289'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.538463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94aea7b379a246258eee7bf4f220e289'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.551410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d33d43db-0d20-486d-91bd-4d5374f10fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94aea7b379a246258eee7bf4f220e289'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.630749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43dbeeee7d90435e9af46f3098ab25c2', 'request_id': 'req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.642332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] The token cache is being invalidate because project 43dbeeee7d90435e9af46f3098ab25c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:33.642619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.643257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:33.645013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 958/1923] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:33 2022] DELETE /identity/v3/projects/43dbeeee7d90435e9af46f3098ab25c2 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:33.649057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:33.650364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:33.704693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 966/1924] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:33 2022] DELETE /identity/v3/users/94aea7b379a246258eee7bf4f220e289 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:33.709144 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d570bf-26e3-4964-b0d9-e476a473d9c7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:33.709421 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d570bf-26e3-4964-b0d9-e476a473d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:33.709698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d570bf-26e3-4964-b0d9-e476a473d9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:33.714110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad651dc9-a6a1-4619-8440-eb2ca207dcfd admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:33.730024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d6d570bf-26e3-4964-b0d9-e476a473d9c7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:33.731244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d6d570bf-26e3-4964-b0d9-e476a473d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:33.769759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:33.770403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:33.770682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:33.770983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] PATH_INFO: `/v3/users/40de29cf276e4771b12b2aeaf876815e` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:33.772182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=40de29cf276e4771b12b2aeaf876815e)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:33.776077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:33.789368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 967/1925] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:33.799191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d570bf-26e3-4964-b0d9-e476a473d9c7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:33.800653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d6d570bf-26e3-4964-b0d9-e476a473d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:33.855929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d570bf-26e3-4964-b0d9-e476a473d9c7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:33.859551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3715-710d-4bea-8aea-5ace79bfeeab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:33.860164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3715-710d-4bea-8aea-5ace79bfeeab service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:33.860449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3715-710d-4bea-8aea-5ace79bfeeab service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:33.860726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3715-710d-4bea-8aea-5ace79bfeeab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:33.869617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf3715-710d-4bea-8aea-5ace79bfeeab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:33.871057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf3715-710d-4bea-8aea-5ace79bfeeab service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:33.881090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 968/1926] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:34.075862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40de29cf276e4771b12b2aeaf876815e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.075862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40de29cf276e4771b12b2aeaf876815e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.248017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40de29cf276e4771b12b2aeaf876815e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.248685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40de29cf276e4771b12b2aeaf876815e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.264698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-60b5f016-2034-4afb-9648-31786a46c18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40de29cf276e4771b12b2aeaf876815e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.294156 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 959/1927] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:33 2022] DELETE /identity/v3/users/40de29cf276e4771b12b2aeaf876815e => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:34.431708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3715-710d-4bea-8aea-5ace79bfeeab service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:34.434313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2fcf3715-710d-4bea-8aea-5ace79bfeeab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:34.454974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3715-710d-4bea-8aea-5ace79bfeeab service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:34.526225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:34.526966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:34.527315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:34.527688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] PATH_INFO: `/v3/projects/179312b681af4d80ae60af658c10b94b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:34.528972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=179312b681af4d80ae60af658c10b94b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:34.531187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:34.659922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179312b681af4d80ae60af658c10b94b', 'request_id': 'req-cfd47bae-792d-435c-ac34-c64066ad2c39'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.750904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179312b681af4d80ae60af658c10b94b', 'request_id': 'req-cfd47bae-792d-435c-ac34-c64066ad2c39'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.760562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179312b681af4d80ae60af658c10b94b', 'request_id': 'req-cfd47bae-792d-435c-ac34-c64066ad2c39'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.774888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] The token cache is being invalidate because project 179312b681af4d80ae60af658c10b94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:34.775962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.776582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cfd47bae-792d-435c-ac34-c64066ad2c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:34.783287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 969/1928] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:34 2022] DELETE /identity/v3/projects/179312b681af4d80ae60af658c10b94b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:34.787421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27ed53-ca36-4f8c-89b6-456883a9d76e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:34.787768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27ed53-ca36-4f8c-89b6-456883a9d76e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:34.788136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27ed53-ca36-4f8c-89b6-456883a9d76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:34.811360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2c27ed53-ca36-4f8c-89b6-456883a9d76e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:34.812685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2c27ed53-ca36-4f8c-89b6-456883a9d76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:34.835794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:34.858282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:34.890976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 960/1929] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:34.899348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8f60-dec5-4fb4-9914-a733ca46cca8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:34.899641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8f60-dec5-4fb4-9914-a733ca46cca8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:34.899916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8f60-dec5-4fb4-9914-a733ca46cca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:34.924482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9d0a8f60-dec5-4fb4-9914-a733ca46cca8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:34.925752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9d0a8f60-dec5-4fb4-9914-a733ca46cca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:34.934894 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 970/1930] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:34.939113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27ed53-ca36-4f8c-89b6-456883a9d76e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:34.950808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27ed53-ca36-4f8c-89b6-456883a9d76e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:34.957964 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:34.959374 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:34.959646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:34.959929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:34.960651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:34.961028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:34.965261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:34.980849 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 961/1931] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:09:34.982044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a8f60-dec5-4fb4-9914-a733ca46cca8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:34.993786 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a8f60-dec5-4fb4-9914-a733ca46cca8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:35.000829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fab69b-37b2-4b81-ba5b-533f5a115a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:35.001466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab69b-37b2-4b81-ba5b-533f5a115a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.001749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab69b-37b2-4b81-ba5b-533f5a115a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.002025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab69b-37b2-4b81-ba5b-533f5a115a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.002699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fab69b-37b2-4b81-ba5b-533f5a115a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:35.004699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fab69b-37b2-4b81-ba5b-533f5a115a6b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:35.112864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:35.114656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:35.128253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 971/1932] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:34 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:35.133685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fab69b-37b2-4b81-ba5b-533f5a115a6b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:35.144208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c6c8e-23fc-4cf1-9374-00aa2283094d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:35.217291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fab69b-37b2-4b81-ba5b-533f5a115a6b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:35.222398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0276d7-cf55-4397-af0d-5d9f97c1a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:35.223030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0276d7-cf55-4397-af0d-5d9f97c1a7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.223423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0276d7-cf55-4397-af0d-5d9f97c1a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.223673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0276d7-cf55-4397-af0d-5d9f97c1a7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.224485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0276d7-cf55-4397-af0d-5d9f97c1a7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:35.226531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0276d7-cf55-4397-af0d-5d9f97c1a7f5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:35.238581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:35.239322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.240317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.240617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] PATH_INFO: `/v3/projects/0e27f111584e400c9c42f0aff3d826cd` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.241914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e27f111584e400c9c42f0aff3d826cd)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:35.244440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:35.352482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 972/1933] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:35 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:35.357013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0276d7-cf55-4397-af0d-5d9f97c1a7f5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:35.368395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0276d7-cf55-4397-af0d-5d9f97c1a7f5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:35.386801 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e27f111584e400c9c42f0aff3d826cd', 'request_id': 'req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:35.394176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e27f111584e400c9c42f0aff3d826cd', 'request_id': 'req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:35.426557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ab1d2-efd8-4d98-b55e-a932891b7fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:35.427258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ab1d2-efd8-4d98-b55e-a932891b7fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.427539 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ab1d2-efd8-4d98-b55e-a932891b7fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.427815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ab1d2-efd8-4d98-b55e-a932891b7fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.428696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ab1d2-efd8-4d98-b55e-a932891b7fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:35.430343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ab1d2-efd8-4d98-b55e-a932891b7fe1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:35.444560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 973/1934] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:35.445718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ab1d2-efd8-4d98-b55e-a932891b7fe1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:35.455969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ab1d2-efd8-4d98-b55e-a932891b7fe1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:35.463437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f530ab-6c4f-44cd-9ae9-1d822c94b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:35.464082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f530ab-6c4f-44cd-9ae9-1d822c94b412 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.464366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f530ab-6c4f-44cd-9ae9-1d822c94b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.464688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f530ab-6c4f-44cd-9ae9-1d822c94b412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.465469 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f530ab-6c4f-44cd-9ae9-1d822c94b412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:35.467085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f530ab-6c4f-44cd-9ae9-1d822c94b412 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:35.478735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 974/1935] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:35.482999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f530ab-6c4f-44cd-9ae9-1d822c94b412 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:35.493587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f530ab-6c4f-44cd-9ae9-1d822c94b412 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:35.498689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfb68a-365f-42d7-9aae-94c129edf6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:35.499300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfb68a-365f-42d7-9aae-94c129edf6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.499587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfb68a-365f-42d7-9aae-94c129edf6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.499868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfb68a-365f-42d7-9aae-94c129edf6d7 admin admin] PATH_INFO: `/v3/projects/944b4c28627748b1aaa1a8fd2d2df979/users/eb2b7be73e534e09a80c69d2f08f0cde/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.516147 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfb68a-365f-42d7-9aae-94c129edf6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944b4c28627748b1aaa1a8fd2d2df979, user_id=eb2b7be73e534e09a80c69d2f08f0cde, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:35.518984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfb68a-365f-42d7-9aae-94c129edf6d7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:35.787527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e27f111584e400c9c42f0aff3d826cd', 'request_id': 'req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:35.797704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] The token cache is being invalidate because project 0e27f111584e400c9c42f0aff3d826cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:35.797995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:35.798643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2fa13781-5788-4f5b-a6ad-d0ae80aaecd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:35.800237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 962/1936] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:35 2022] DELETE /identity/v3/projects/0e27f111584e400c9c42f0aff3d826cd => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:35.804812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a0e07-49b5-43ce-a3fc-45f9589c92f4 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.805101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a0e07-49b5-43ce-a3fc-45f9589c92f4 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.805413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a0e07-49b5-43ce-a3fc-45f9589c92f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.826883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-459a0e07-49b5-43ce-a3fc-45f9589c92f4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:35.828172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-459a0e07-49b5-43ce-a3fc-45f9589c92f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:35.837070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 963/1937] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:35.844707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae05be7-2ba2-4a2c-984f-9ac4a4cdaa35 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.845122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae05be7-2ba2-4a2c-984f-9ac4a4cdaa35 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.845408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae05be7-2ba2-4a2c-984f-9ac4a4cdaa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.866246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-cae05be7-2ba2-4a2c-984f-9ac4a4cdaa35 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:35.867439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cae05be7-2ba2-4a2c-984f-9ac4a4cdaa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:35.875615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 964/1938] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:35.879915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae05be7-2ba2-4a2c-984f-9ac4a4cdaa35 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:35.888757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae05be7-2ba2-4a2c-984f-9ac4a4cdaa35 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:35.893731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 975/1939] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:35 2022] PUT /identity/v3/projects/944b4c28627748b1aaa1a8fd2d2df979/users/eb2b7be73e534e09a80c69d2f08f0cde/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:35.899118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82677135-31d6-4bdb-9659-36ad6b41d2d2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.899408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82677135-31d6-4bdb-9659-36ad6b41d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.899690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82677135-31d6-4bdb-9659-36ad6b41d2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.918796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-82677135-31d6-4bdb-9659-36ad6b41d2d2 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:35.920184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-82677135-31d6-4bdb-9659-36ad6b41d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:35.957720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b91dac-89d7-45ae-986b-675aff39594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:35.958996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b91dac-89d7-45ae-986b-675aff39594f admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:35.959896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b91dac-89d7-45ae-986b-675aff39594f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:35.959896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b91dac-89d7-45ae-986b-675aff39594f admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:35.962341 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b91dac-89d7-45ae-986b-675aff39594f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:35.963176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b91dac-89d7-45ae-986b-675aff39594f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:35.965041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b91dac-89d7-45ae-986b-675aff39594f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:35.981734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 965/1940] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:09:35.991351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b91dac-89d7-45ae-986b-675aff39594f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:36.010943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b91dac-89d7-45ae-986b-675aff39594f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:36.029661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31353d-aeec-4581-aec6-5d883cfba338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:36.029885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31353d-aeec-4581-aec6-5d883cfba338 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:36.030162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31353d-aeec-4581-aec6-5d883cfba338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:36.030433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31353d-aeec-4581-aec6-5d883cfba338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:36.031098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31353d-aeec-4581-aec6-5d883cfba338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:36.032620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 976/1941] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:36.034072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31353d-aeec-4581-aec6-5d883cfba338 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:36.045092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82677135-31d6-4bdb-9659-36ad6b41d2d2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:36.048714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-82677135-31d6-4bdb-9659-36ad6b41d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:36.134855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82677135-31d6-4bdb-9659-36ad6b41d2d2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:36.139233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ac55e-6ce1-41f8-a6f7-5171cac2ad5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:36.139913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ac55e-6ce1-41f8-a6f7-5171cac2ad5c service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:36.140200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ac55e-6ce1-41f8-a6f7-5171cac2ad5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:36.140474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ac55e-6ce1-41f8-a6f7-5171cac2ad5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:36.153882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ac55e-6ce1-41f8-a6f7-5171cac2ad5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:36.156106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ac55e-6ce1-41f8-a6f7-5171cac2ad5c service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:36.185132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 966/1942] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:35 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:36.190194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31353d-aeec-4581-aec6-5d883cfba338 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:36.192340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 977/1943] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:36.294990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31353d-aeec-4581-aec6-5d883cfba338 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:36.300083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39ad80-4a67-4c17-a742-2c5ffb505620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:36.300701 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39ad80-4a67-4c17-a742-2c5ffb505620 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:36.301023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39ad80-4a67-4c17-a742-2c5ffb505620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:36.301298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39ad80-4a67-4c17-a742-2c5ffb505620 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:36.301990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39ad80-4a67-4c17-a742-2c5ffb505620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:36.304256 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39ad80-4a67-4c17-a742-2c5ffb505620 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:36.413163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 967/1944] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:36 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:36.414417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ac55e-6ce1-41f8-a6f7-5171cac2ad5c service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:36.424744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ac55e-6ce1-41f8-a6f7-5171cac2ad5c service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:36.429646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788fd54-f29f-496e-af6e-605f9196f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:36.430267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788fd54-f29f-496e-af6e-605f9196f592 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:36.430546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788fd54-f29f-496e-af6e-605f9196f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:36.430979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788fd54-f29f-496e-af6e-605f9196f592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:36.431929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788fd54-f29f-496e-af6e-605f9196f592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:36.433707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788fd54-f29f-496e-af6e-605f9196f592 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:36.448328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 978/1945] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:36.449619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39ad80-4a67-4c17-a742-2c5ffb505620 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:36.459709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39ad80-4a67-4c17-a742-2c5ffb505620 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:36.464953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebd75d-3229-4b07-b5c5-22b5eadb7b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:36.465695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebd75d-3229-4b07-b5c5-22b5eadb7b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:36.465975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebd75d-3229-4b07-b5c5-22b5eadb7b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:36.466273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebd75d-3229-4b07-b5c5-22b5eadb7b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:36.467621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebd75d-3229-4b07-b5c5-22b5eadb7b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:36.469257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebd75d-3229-4b07-b5c5-22b5eadb7b7e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:36.484103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 968/1946] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:36.485327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788fd54-f29f-496e-af6e-605f9196f592 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:36.495323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788fd54-f29f-496e-af6e-605f9196f592 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:36.499964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6fb5-0a0a-441a-b8ed-7db580c2d721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:36.500639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6fb5-0a0a-441a-b8ed-7db580c2d721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:36.500946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6fb5-0a0a-441a-b8ed-7db580c2d721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:36.501219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6fb5-0a0a-441a-b8ed-7db580c2d721 admin admin] PATH_INFO: `/v3/projects/b2cecf98dbee467185d324169e872603/users/4a45f61c05734ff69df106b6c4507e66/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:36.518531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6fb5-0a0a-441a-b8ed-7db580c2d721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cecf98dbee467185d324169e872603, user_id=4a45f61c05734ff69df106b6c4507e66, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:36.521703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:36.521823 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6fb5-0a0a-441a-b8ed-7db580c2d721 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:36.652120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 979/1947] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:36 2022] PUT /identity/v3/projects/b2cecf98dbee467185d324169e872603/users/4a45f61c05734ff69df106b6c4507e66/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:36.663386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5668-6963-4064-acd4-824300d24fe8 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:36.663804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5668-6963-4064-acd4-824300d24fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:36.664177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5668-6963-4064-acd4-824300d24fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:36.715984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-850a5668-6963-4064-acd4-824300d24fe8 None None] MFA Rules not processed for user `4a45f61c05734ff69df106b6c4507e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:36.716567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-850a5668-6963-4064-acd4-824300d24fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:36.871111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 969/1948] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:36.875775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6fb5-0a0a-441a-b8ed-7db580c2d721 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:36.966542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6fb5-0a0a-441a-b8ed-7db580c2d721 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:36.973006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c6cd-632e-4c36-99ea-f7d4df9db6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:36.973878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c6cd-632e-4c36-99ea-f7d4df9db6de admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:36.974248 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c6cd-632e-4c36-99ea-f7d4df9db6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:36.974595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c6cd-632e-4c36-99ea-f7d4df9db6de admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:36.975599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c6cd-632e-4c36-99ea-f7d4df9db6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:36.982428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c6cd-632e-4c36-99ea-f7d4df9db6de admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:37.131047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 980/1949] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:36 2022] POST /identity/v3/projects => generated 367 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:37.134822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a5668-6963-4064-acd4-824300d24fe8 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:37.147524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a5668-6963-4064-acd4-824300d24fe8 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:37.233934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4ff42-d996-459b-b46b-81ef77b7a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:37.234711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4ff42-d996-459b-b46b-81ef77b7a929 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:37.235069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4ff42-d996-459b-b46b-81ef77b7a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:37.235416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4ff42-d996-459b-b46b-81ef77b7a929 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:37.236159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4ff42-d996-459b-b46b-81ef77b7a929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:37.238623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4ff42-d996-459b-b46b-81ef77b7a929 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:37.376828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 970/1950] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:37 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:37.378459 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c6cd-632e-4c36-99ea-f7d4df9db6de admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:37.389323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c6cd-632e-4c36-99ea-f7d4df9db6de admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:37.393891 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ff45-d5ef-4572-bbd0-9e9e50b869e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:37.394526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ff45-d5ef-4572-bbd0-9e9e50b869e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:37.394808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ff45-d5ef-4572-bbd0-9e9e50b869e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:37.395083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ff45-d5ef-4572-bbd0-9e9e50b869e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:37.396305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ff45-d5ef-4572-bbd0-9e9e50b869e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:37.397992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ff45-d5ef-4572-bbd0-9e9e50b869e7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:37.405518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:DELETE=1,keystone:INSERT=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:37.412117 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 981/1951] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:37.416590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4ff42-d996-459b-b46b-81ef77b7a929 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:37.428134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4ff42-d996-459b-b46b-81ef77b7a929 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:37.432959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e9a9a-d541-40a2-86a2-834517551a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:37.433615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e9a9a-d541-40a2-86a2-834517551a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:37.433892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e9a9a-d541-40a2-86a2-834517551a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:37.434167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e9a9a-d541-40a2-86a2-834517551a19 admin admin] PATH_INFO: `/v3/projects/caebcbe1496343098c98f6db6e643e9f/users/d7e41ff6b10241c0ba1a116508b69145/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:37.450168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e9a9a-d541-40a2-86a2-834517551a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caebcbe1496343098c98f6db6e643e9f, user_id=d7e41ff6b10241c0ba1a116508b69145, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:37.452930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e9a9a-d541-40a2-86a2-834517551a19 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:37.574884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 971/1952] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:37 2022] PUT /identity/v3/projects/caebcbe1496343098c98f6db6e643e9f/users/d7e41ff6b10241c0ba1a116508b69145/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:37.578845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ff45-d5ef-4572-bbd0-9e9e50b869e7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:37.589136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ff45-d5ef-4572-bbd0-9e9e50b869e7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:37.655630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0930a-303e-42c0-b94e-9d0050cb2c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:37.656028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0930a-303e-42c0-b94e-9d0050cb2c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:37.656376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0930a-303e-42c0-b94e-9d0050cb2c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:37.657009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0930a-303e-42c0-b94e-9d0050cb2c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:37.657784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0930a-303e-42c0-b94e-9d0050cb2c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:37.659479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0930a-303e-42c0-b94e-9d0050cb2c7c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:37.671489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 982/1953] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:37.675411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e9a9a-d541-40a2-86a2-834517551a19 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:37.687820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e9a9a-d541-40a2-86a2-834517551a19 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:37.692688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737145e5-cec4-4357-bfd6-cdc496c1574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:37.693472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737145e5-cec4-4357-bfd6-cdc496c1574c admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:37.693751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737145e5-cec4-4357-bfd6-cdc496c1574c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:37.694027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737145e5-cec4-4357-bfd6-cdc496c1574c admin admin] PATH_INFO: `/v3/projects/caebcbe1496343098c98f6db6e643e9f/users/d7e41ff6b10241c0ba1a116508b69145/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:37.696036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737145e5-cec4-4357-bfd6-cdc496c1574c admin admin] RBAC: Authorizing `identity:create_grant(project_id=caebcbe1496343098c98f6db6e643e9f, user_id=d7e41ff6b10241c0ba1a116508b69145, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:37.701808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737145e5-cec4-4357-bfd6-cdc496c1574c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:37.713473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 972/1954] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:37 2022] PUT /identity/v3/projects/caebcbe1496343098c98f6db6e643e9f/users/d7e41ff6b10241c0ba1a116508b69145/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:37.725870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b23b02-42df-4b02-b4ba-dd7edf2f1a46 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:37.726323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b23b02-42df-4b02-b4ba-dd7edf2f1a46 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:37.727027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b23b02-42df-4b02-b4ba-dd7edf2f1a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:37.781692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-77b23b02-42df-4b02-b4ba-dd7edf2f1a46 None None] MFA Rules not processed for user `d7e41ff6b10241c0ba1a116508b69145`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:37.788006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-77b23b02-42df-4b02-b4ba-dd7edf2f1a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:37.849876 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10f95-5cb1-4ad4-9af2-6aa356a8aa0e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:37.850159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10f95-5cb1-4ad4-9af2-6aa356a8aa0e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:37.850453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10f95-5cb1-4ad4-9af2-6aa356a8aa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:37.881939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-bfd10f95-5cb1-4ad4-9af2-6aa356a8aa0e None None] MFA Rules not processed for user `eb2b7be73e534e09a80c69d2f08f0cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:37.883426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bfd10f95-5cb1-4ad4-9af2-6aa356a8aa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:37.909741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 983/1955] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:37.922987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b23b02-42df-4b02-b4ba-dd7edf2f1a46 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:37.925824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-77b23b02-42df-4b02-b4ba-dd7edf2f1a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:37.961845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 973/1956] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:37.975433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:38.006895 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b23b02-42df-4b02-b4ba-dd7edf2f1a46 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:38.012952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfcbe0-1f8f-4fe0-b5ec-44cfe7b0f7b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:38.013634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfcbe0-1f8f-4fe0-b5ec-44cfe7b0f7b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:38.013948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfcbe0-1f8f-4fe0-b5ec-44cfe7b0f7b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:38.015140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfcbe0-1f8f-4fe0-b5ec-44cfe7b0f7b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:38.022090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10f95-5cb1-4ad4-9af2-6aa356a8aa0e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:38.023562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bfd10f95-5cb1-4ad4-9af2-6aa356a8aa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:38.031086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfcbe0-1f8f-4fe0-b5ec-44cfe7b0f7b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:38.032612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfcbe0-1f8f-4fe0-b5ec-44cfe7b0f7b7 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:38.036166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10f95-5cb1-4ad4-9af2-6aa356a8aa0e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:38.040651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc3b2-c406-4aa4-8f11-3f2a3dc94870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:38.041308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc3b2-c406-4aa4-8f11-3f2a3dc94870 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:38.041594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc3b2-c406-4aa4-8f11-3f2a3dc94870 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:38.041872 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc3b2-c406-4aa4-8f11-3f2a3dc94870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:38.044169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 984/1957] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:38.056154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cc3b2-c406-4aa4-8f11-3f2a3dc94870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:38.057727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cc3b2-c406-4aa4-8f11-3f2a3dc94870 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:38.070512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 974/1958] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:39.514268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfcbe0-1f8f-4fe0-b5ec-44cfe7b0f7b7 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:39.515753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c0dfcbe0-1f8f-4fe0-b5ec-44cfe7b0f7b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:39.593430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfcbe0-1f8f-4fe0-b5ec-44cfe7b0f7b7 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:39.597970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:39.598596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:39.599448 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:39.599720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] PATH_INFO: `/v3/users/447e163734594f7a8bce9504984b02e1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:39.600907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=447e163734594f7a8bce9504984b02e1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:39.602815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:39.676988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc3b2-c406-4aa4-8f11-3f2a3dc94870 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:39.680543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-801cc3b2-c406-4aa4-8f11-3f2a3dc94870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:39.698509 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc3b2-c406-4aa4-8f11-3f2a3dc94870 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:39.712939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:39.713930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:39.714423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:39.715287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] PATH_INFO: `/v3/users/271bd1b667c44a0394039e088497cce2` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:39.716907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271bd1b667c44a0394039e088497cce2)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:39.718709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:39.873397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447e163734594f7a8bce9504984b02e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:39.873993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447e163734594f7a8bce9504984b02e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:39.883091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447e163734594f7a8bce9504984b02e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:39.883783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447e163734594f7a8bce9504984b02e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:39.896502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0ffaac58-0b0c-4b53-8613-0b4b72c1de12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447e163734594f7a8bce9504984b02e1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:39.965249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271bd1b667c44a0394039e088497cce2'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:39.966025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271bd1b667c44a0394039e088497cce2'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:39.985373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 985/1959] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:39 2022] DELETE /identity/v3/users/447e163734594f7a8bce9504984b02e1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:40.053741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271bd1b667c44a0394039e088497cce2'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:40.054395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271bd1b667c44a0394039e088497cce2'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:40.068462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271bd1b667c44a0394039e088497cce2'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:40.081439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 975/1960] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:39 2022] DELETE /identity/v3/users/271bd1b667c44a0394039e088497cce2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:40.087587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1a03b-2edb-4558-8839-665344f594cb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.087587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1a03b-2edb-4558-8839-665344f594cb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.087916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1a03b-2edb-4558-8839-665344f594cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.108504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7df1a03b-2edb-4558-8839-665344f594cb None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:40.109734 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7df1a03b-2edb-4558-8839-665344f594cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:40.175528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 986/1961] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:40.185661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:40.187066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:40.250211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1a03b-2edb-4558-8839-665344f594cb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:40.252760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4eada-64ab-4197-bce2-c1ef809f7a01 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:40.252906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7df1a03b-2edb-4558-8839-665344f594cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:40.261781 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cc7f1-b7e9-4c84-bf3d-e7363b8dd83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:40.262436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cc7f1-b7e9-4c84-bf3d-e7363b8dd83d service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.262721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cc7f1-b7e9-4c84-bf3d-e7363b8dd83d service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.263184 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cc7f1-b7e9-4c84-bf3d-e7363b8dd83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.267021 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1a03b-2edb-4558-8839-665344f594cb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:40.284341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:40.284475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cc7f1-b7e9-4c84-bf3d-e7363b8dd83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:40.285090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.285320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.285633 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] PATH_INFO: `/v3/projects/816fb0e7557d4fd6b550f81514a13e67` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.286008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cc7f1-b7e9-4c84-bf3d-e7363b8dd83d service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:40.287488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=816fb0e7557d4fd6b550f81514a13e67)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:40.289532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:40.307594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:40.308768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 976/1962] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:40.471692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816fb0e7557d4fd6b550f81514a13e67', 'request_id': 'req-6c0dce69-d031-415d-b75a-542ad87aaa1f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:40.655391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816fb0e7557d4fd6b550f81514a13e67', 'request_id': 'req-6c0dce69-d031-415d-b75a-542ad87aaa1f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:40.655391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816fb0e7557d4fd6b550f81514a13e67', 'request_id': 'req-6c0dce69-d031-415d-b75a-542ad87aaa1f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:40.655391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] The token cache is being invalidate because project 816fb0e7557d4fd6b550f81514a13e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:40.655391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:40.656685 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c0dce69-d031-415d-b75a-542ad87aaa1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:40.656935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 987/1963] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:40 2022] DELETE /identity/v3/projects/816fb0e7557d4fd6b550f81514a13e67 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:40.662161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a533c-22dc-4f4e-84db-d6e86586ade1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.662913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a533c-22dc-4f4e-84db-d6e86586ade1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.662913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a533c-22dc-4f4e-84db-d6e86586ade1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.688190 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b67a533c-22dc-4f4e-84db-d6e86586ade1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:40.689629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b67a533c-22dc-4f4e-84db-d6e86586ade1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:40.753574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 977/1964] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:40.761820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41eba6-4f23-4286-8525-c286a640c42a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.762140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41eba6-4f23-4286-8525-c286a640c42a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.762487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41eba6-4f23-4286-8525-c286a640c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.784899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-eb41eba6-4f23-4286-8525-c286a640c42a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:40.786284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-eb41eba6-4f23-4286-8525-c286a640c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:40.795910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 988/1965] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:40.805795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a533c-22dc-4f4e-84db-d6e86586ade1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:40.816155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a533c-22dc-4f4e-84db-d6e86586ade1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:40.821472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdadfb-9465-407c-8f99-2295845bc424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:40.822098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdadfb-9465-407c-8f99-2295845bc424 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.822382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdadfb-9465-407c-8f99-2295845bc424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.822655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdadfb-9465-407c-8f99-2295845bc424 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.823380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdadfb-9465-407c-8f99-2295845bc424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:40.823660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdadfb-9465-407c-8f99-2295845bc424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:40.825295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdadfb-9465-407c-8f99-2295845bc424 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:40.831839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41eba6-4f23-4286-8525-c286a640c42a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:40.833315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-eb41eba6-4f23-4286-8525-c286a640c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:40.842226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 978/1966] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:09:40.846725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdadfb-9465-407c-8f99-2295845bc424 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:40.851522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41eba6-4f23-4286-8525-c286a640c42a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:40.856524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdadfb-9465-407c-8f99-2295845bc424 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:40.859171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:40.860262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.860858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.861280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b3333-45e4-4b9b-88d7-a12e32f516ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:40.861394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] PATH_INFO: `/v3/users/9c9ff32ef8c14e5f839fe38817f43cc3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.861881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b3333-45e4-4b9b-88d7-a12e32f516ca admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:40.862163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b3333-45e4-4b9b-88d7-a12e32f516ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:40.862438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b3333-45e4-4b9b-88d7-a12e32f516ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:40.863126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b3333-45e4-4b9b-88d7-a12e32f516ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:40.863523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9ff32ef8c14e5f839fe38817f43cc3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:40.865122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b3333-45e4-4b9b-88d7-a12e32f516ca admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:40.869550 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.007700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 979/1967] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:40 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:41.007700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b3333-45e4-4b9b-88d7-a12e32f516ca admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.007700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-414b3333-45e4-4b9b-88d7-a12e32f516ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.070192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9ff32ef8c14e5f839fe38817f43cc3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.071002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9ff32ef8c14e5f839fe38817f43cc3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.077527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b3333-45e4-4b9b-88d7-a12e32f516ca admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:41.078779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9ff32ef8c14e5f839fe38817f43cc3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.080251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9ff32ef8c14e5f839fe38817f43cc3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.082582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:41.083270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.083543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.083822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] PATH_INFO: `/v3/projects/3a1b936d7c384f2fba40e0fdaaff9439` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.085019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1b936d7c384f2fba40e0fdaaff9439)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:41.087258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.095490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9ff32ef8c14e5f839fe38817f43cc3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.180691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 989/1968] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:40 2022] DELETE /identity/v3/users/9c9ff32ef8c14e5f839fe38817f43cc3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:41.180971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.182323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.251512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f01fd-ee12-40e6-8174-1c36b48eb005 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:41.258843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1b936d7c384f2fba40e0fdaaff9439', 'request_id': 'req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.264613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1b936d7c384f2fba40e0fdaaff9439', 'request_id': 'req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.307320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a89e-2691-4128-8495-027281b9f9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:41.307936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a89e-2691-4128-8495-027281b9f9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.308221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a89e-2691-4128-8495-027281b9f9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.308499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a89e-2691-4128-8495-027281b9f9a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.309212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135a89e-2691-4128-8495-027281b9f9a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:41.311125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135a89e-2691-4128-8495-027281b9f9a2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.378359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:41.379086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1b936d7c384f2fba40e0fdaaff9439', 'request_id': 'req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.391534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] The token cache is being invalidate because project 3a1b936d7c384f2fba40e0fdaaff9439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:41.391823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.392526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9ecb64a9-7d5f-40f9-90a9-da720c10bd8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.394359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 980/1969] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:41 2022] DELETE /identity/v3/projects/3a1b936d7c384f2fba40e0fdaaff9439 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:41.395344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3d70-5acd-4512-ad3c-1f6bf8538ef3 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.395664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3d70-5acd-4512-ad3c-1f6bf8538ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.396444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3d70-5acd-4512-ad3c-1f6bf8538ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.415588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-210d3d70-5acd-4512-ad3c-1f6bf8538ef3 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:41.416802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-210d3d70-5acd-4512-ad3c-1f6bf8538ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.424317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 981/1970] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:41.425129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d3d70-5acd-4512-ad3c-1f6bf8538ef3 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.426480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-210d3d70-5acd-4512-ad3c-1f6bf8538ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.437727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d3d70-5acd-4512-ad3c-1f6bf8538ef3 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:41.442208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:41.443312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.443590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.443863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] PATH_INFO: `/v3/users/4f66fe794fa04c4389763d5e949992f8` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.445049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f66fe794fa04c4389763d5e949992f8)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:41.446956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.480581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 990/1971] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:41 2022] POST /identity/v3/users => generated 295 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:41.480581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a89e-2691-4128-8495-027281b9f9a2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.480581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2135a89e-2691-4128-8495-027281b9f9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.537379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a89e-2691-4128-8495-027281b9f9a2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:41.542954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812eff-5ca9-46d2-98e3-a211e65ba082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:41.543666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812eff-5ca9-46d2-98e3-a211e65ba082 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.544050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812eff-5ca9-46d2-98e3-a211e65ba082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.544228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812eff-5ca9-46d2-98e3-a211e65ba082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.554353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1812eff-5ca9-46d2-98e3-a211e65ba082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:41.555869 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1812eff-5ca9-46d2-98e3-a211e65ba082 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.572521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 991/1972] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:41.572521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812eff-5ca9-46d2-98e3-a211e65ba082 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.572521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e1812eff-5ca9-46d2-98e3-a211e65ba082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.582267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812eff-5ca9-46d2-98e3-a211e65ba082 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:41.588677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739438e2-bbee-4f49-b734-1704d6afb843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:41.589389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739438e2-bbee-4f49-b734-1704d6afb843 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.589674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739438e2-bbee-4f49-b734-1704d6afb843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.589951 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739438e2-bbee-4f49-b734-1704d6afb843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.590721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739438e2-bbee-4f49-b734-1704d6afb843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:41.592225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739438e2-bbee-4f49-b734-1704d6afb843 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.603587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 992/1973] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:41.609296 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739438e2-bbee-4f49-b734-1704d6afb843 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.619047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739438e2-bbee-4f49-b734-1704d6afb843 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:41.623664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614284ae-9363-4075-b6dd-0872f6a28485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:41.624263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614284ae-9363-4075-b6dd-0872f6a28485 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.624546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614284ae-9363-4075-b6dd-0872f6a28485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.624848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614284ae-9363-4075-b6dd-0872f6a28485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.625569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614284ae-9363-4075-b6dd-0872f6a28485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:41.627373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614284ae-9363-4075-b6dd-0872f6a28485 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.640676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 993/1974] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:41.641669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614284ae-9363-4075-b6dd-0872f6a28485 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.652475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614284ae-9363-4075-b6dd-0872f6a28485 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:41.657139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854294a3-d996-4a28-ad21-29a68d2b7f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:41.657836 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854294a3-d996-4a28-ad21-29a68d2b7f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.658237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854294a3-d996-4a28-ad21-29a68d2b7f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.658517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854294a3-d996-4a28-ad21-29a68d2b7f6e admin admin] PATH_INFO: `/v3/projects/0a6a212dd48d442e8cf62f4fcd8268bc/users/7b48b352a5514bab8651977f5f9ef040/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.675394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854294a3-d996-4a28-ad21-29a68d2b7f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6a212dd48d442e8cf62f4fcd8268bc, user_id=7b48b352a5514bab8651977f5f9ef040, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:41.685709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854294a3-d996-4a28-ad21-29a68d2b7f6e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:41.753561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f66fe794fa04c4389763d5e949992f8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.754211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f66fe794fa04c4389763d5e949992f8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.848632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 994/1975] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:41 2022] PUT /identity/v3/projects/0a6a212dd48d442e8cf62f4fcd8268bc/users/7b48b352a5514bab8651977f5f9ef040/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:41.861292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21e6f-159b-4450-b9eb-e08d90cf8584 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.861751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21e6f-159b-4450-b9eb-e08d90cf8584 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.862105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21e6f-159b-4450-b9eb-e08d90cf8584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.882644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7bd21e6f-159b-4450-b9eb-e08d90cf8584 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:41.883844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7bd21e6f-159b-4450-b9eb-e08d90cf8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.905044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f66fe794fa04c4389763d5e949992f8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.905591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f66fe794fa04c4389763d5e949992f8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.929147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-23b2ed48-5e20-47dc-9771-accd24b66b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f66fe794fa04c4389763d5e949992f8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:41.946536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 982/1976] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:41 2022] DELETE /identity/v3/users/4f66fe794fa04c4389763d5e949992f8 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:41.947984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf82d-fee5-4b67-be1d-3240c4de6120 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:41.948271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf82d-fee5-4b67-be1d-3240c4de6120 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:41.948551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf82d-fee5-4b67-be1d-3240c4de6120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:41.963356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 995/1977] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:41.980486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-6dbbf82d-fee5-4b67-be1d-3240c4de6120 None None] MFA Rules not processed for user `eb2b7be73e534e09a80c69d2f08f0cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:41.981837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd21e6f-159b-4450-b9eb-e08d90cf8584 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:41.982463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6dbbf82d-fee5-4b67-be1d-3240c4de6120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:41.988538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7bd21e6f-159b-4450-b9eb-e08d90cf8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:42.059818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd21e6f-159b-4450-b9eb-e08d90cf8584 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:42.066461 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 983/1978] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:42.109466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf82d-fee5-4b67-be1d-3240c4de6120 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:42.109466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6dbbf82d-fee5-4b67-be1d-3240c4de6120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:42.125075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b0d3d-f47b-4887-9d67-7e49f335e6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:42.125727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b0d3d-f47b-4887-9d67-7e49f335e6cd service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:42.126098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b0d3d-f47b-4887-9d67-7e49f335e6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:42.126523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b0d3d-f47b-4887-9d67-7e49f335e6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:42.215847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf82d-fee5-4b67-be1d-3240c4de6120 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:42.226616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:42.227378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:42.227678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:42.227943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] PATH_INFO: `/v3/projects/d62bb19328144c598c047262da10199d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:42.229567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62bb19328144c598c047262da10199d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:42.231528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:42.237758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b0d3d-f47b-4887-9d67-7e49f335e6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:42.239480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b0d3d-f47b-4887-9d67-7e49f335e6cd service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:42.249689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 996/1979] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:42.406709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62bb19328144c598c047262da10199d', 'request_id': 'req-d9875b84-bca8-4c30-b517-69215cb888e8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.413960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:42.417901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62bb19328144c598c047262da10199d', 'request_id': 'req-d9875b84-bca8-4c30-b517-69215cb888e8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.550417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62bb19328144c598c047262da10199d', 'request_id': 'req-d9875b84-bca8-4c30-b517-69215cb888e8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.565465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] The token cache is being invalidate because project d62bb19328144c598c047262da10199d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:42.565743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.566427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.568014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 984/1980] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:42 2022] DELETE /identity/v3/projects/d62bb19328144c598c047262da10199d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:42.572419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b0d3d-f47b-4887-9d67-7e49f335e6cd service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:42.582795 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b0d3d-f47b-4887-9d67-7e49f335e6cd service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:42.643363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:42.644150 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:42.644430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:42.644706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] PATH_INFO: `/v3/users/0807c1755dbd47a4818d7e4ffd6be134` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:42.646474 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0807c1755dbd47a4818d7e4ffd6be134)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:42.648577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:42.814703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:42.818330 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:42.843456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9875b84-bca8-4c30-b517-69215cb888e8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:42.851550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:42.852022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:42.852194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:42.852667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] PATH_INFO: `/v3/projects/758d7d408c174de3a03c75b92a6a8764` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:42.854601 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758d7d408c174de3a03c75b92a6a8764)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:42.857023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:42.949749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0807c1755dbd47a4818d7e4ffd6be134'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.949749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0807c1755dbd47a4818d7e4ffd6be134'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.952331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0807c1755dbd47a4818d7e4ffd6be134'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.953040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0807c1755dbd47a4818d7e4ffd6be134'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.975637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758d7d408c174de3a03c75b92a6a8764', 'request_id': 'req-180615a3-5e5a-4d6f-a804-aebfbff19573'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.975742 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5585acb5-a376-46b8-a841-e77cca56795e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0807c1755dbd47a4818d7e4ffd6be134'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:42.981591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758d7d408c174de3a03c75b92a6a8764', 'request_id': 'req-180615a3-5e5a-4d6f-a804-aebfbff19573'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:43.107697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 997/1981] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:42 2022] DELETE /identity/v3/users/0807c1755dbd47a4818d7e4ffd6be134 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:43.213702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758d7d408c174de3a03c75b92a6a8764', 'request_id': 'req-180615a3-5e5a-4d6f-a804-aebfbff19573'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:43.228901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] The token cache is being invalidate because project 758d7d408c174de3a03c75b92a6a8764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:43.229152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:43.229808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:43.231334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 985/1982] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:42 2022] DELETE /identity/v3/projects/758d7d408c174de3a03c75b92a6a8764 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:43.236127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fced97-5cea-4f79-9f38-b0538cdc96b5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:43.236415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fced97-5cea-4f79-9f38-b0538cdc96b5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:43.236692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fced97-5cea-4f79-9f38-b0538cdc96b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:43.257142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-84fced97-5cea-4f79-9f38-b0538cdc96b5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:43.258348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-84fced97-5cea-4f79-9f38-b0538cdc96b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:43.304476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:43.307778 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:43.318721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 998/1983] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:43.326800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63954f2b-cea0-4d5d-ad6c-7bbd0ce5bb5c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:43.327086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63954f2b-cea0-4d5d-ad6c-7bbd0ce5bb5c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:43.327366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63954f2b-cea0-4d5d-ad6c-7bbd0ce5bb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:43.349845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-63954f2b-cea0-4d5d-ad6c-7bbd0ce5bb5c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:43.351123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-63954f2b-cea0-4d5d-ad6c-7bbd0ce5bb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:43.362315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 999/1984] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:43.366802 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63954f2b-cea0-4d5d-ad6c-7bbd0ce5bb5c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:43.383312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63954f2b-cea0-4d5d-ad6c-7bbd0ce5bb5c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:43.388434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ae681-1816-478b-ab43-13424c13d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:43.389280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ae681-1816-478b-ab43-13424c13d1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:43.389534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ae681-1816-478b-ab43-13424c13d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:43.389806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ae681-1816-478b-ab43-13424c13d1fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:43.390523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ae681-1816-478b-ab43-13424c13d1fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:43.390823 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ae681-1816-478b-ab43-13424c13d1fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:43.392443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ae681-1816-478b-ab43-13424c13d1fd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:43.403843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:43.411006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1000/1985] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:09:43.414945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180615a3-5e5a-4d6f-a804-aebfbff19573 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:43.416330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ae681-1816-478b-ab43-13424c13d1fd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:43.421573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:43.422240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:43.422520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:43.422822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] PATH_INFO: `/v3/users/4a45f61c05734ff69df106b6c4507e66` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:43.426077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a45f61c05734ff69df106b6c4507e66)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:43.427736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:43.430811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ae681-1816-478b-ab43-13424c13d1fd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:43.436210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7f9db-ed5b-4d3d-9c44-f4211984250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:43.437163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f9db-ed5b-4d3d-9c44-f4211984250f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:43.437515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f9db-ed5b-4d3d-9c44-f4211984250f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:43.437892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f9db-ed5b-4d3d-9c44-f4211984250f admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:43.438954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7f9db-ed5b-4d3d-9c44-f4211984250f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:43.440693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7f9db-ed5b-4d3d-9c44-f4211984250f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:43.655799 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1001/1986] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:43 2022] POST /identity/v3/projects => generated 381 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:43.659762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7f9db-ed5b-4d3d-9c44-f4211984250f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:43.729658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7f9db-ed5b-4d3d-9c44-f4211984250f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:43.734542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e8fc0-247e-4448-b309-63588fdb452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:43.735248 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e8fc0-247e-4448-b309-63588fdb452b admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:43.736177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e8fc0-247e-4448-b309-63588fdb452b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:43.736468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e8fc0-247e-4448-b309-63588fdb452b admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:43.737360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e8fc0-247e-4448-b309-63588fdb452b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:43.739111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e8fc0-247e-4448-b309-63588fdb452b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:43.761544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a45f61c05734ff69df106b6c4507e66'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:43.762217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a45f61c05734ff69df106b6c4507e66'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:43.905339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a45f61c05734ff69df106b6c4507e66'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:43.906116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a45f61c05734ff69df106b6c4507e66'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:43.915777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1002/1987] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:43 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:43.915777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e8fc0-247e-4448-b309-63588fdb452b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:43.917042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-019e8fc0-247e-4448-b309-63588fdb452b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:43.919967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a45f61c05734ff69df106b6c4507e66'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:43.929446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e8fc0-247e-4448-b309-63588fdb452b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:43.932586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 986/1988] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:43 2022] DELETE /identity/v3/users/4a45f61c05734ff69df106b6c4507e66 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:43.933429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:43.934703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:43.936968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:43.937615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:43.937899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:43.938177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] PATH_INFO: `/v3/projects/fbdc111c93a34e398119baed8eb07e28` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:43.939489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbdc111c93a34e398119baed8eb07e28)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:43.941293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:44.004023 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781749a-4eac-42af-b207-21e292a4ba8b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:44.008985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18af7e-f486-4237-a733-921f60de4eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:44.009544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18af7e-f486-4237-a733-921f60de4eac admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.009827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18af7e-f486-4237-a733-921f60de4eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.010101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18af7e-f486-4237-a733-921f60de4eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.010795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18af7e-f486-4237-a733-921f60de4eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:44.012388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18af7e-f486-4237-a733-921f60de4eac admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:44.022710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 987/1989] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:44.023999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72619874-514f-4c23-b1ab-e5f70c4bc5af None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.024309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72619874-514f-4c23-b1ab-e5f70c4bc5af None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.024567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72619874-514f-4c23-b1ab-e5f70c4bc5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.043085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-72619874-514f-4c23-b1ab-e5f70c4bc5af None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:44.044279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-72619874-514f-4c23-b1ab-e5f70c4bc5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:44.052263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 988/1990] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:44.053140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72619874-514f-4c23-b1ab-e5f70c4bc5af None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:44.065610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72619874-514f-4c23-b1ab-e5f70c4bc5af None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:44.070464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6824623-256b-4495-8e1a-5fe6dac31906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:44.071082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6824623-256b-4495-8e1a-5fe6dac31906 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.071367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6824623-256b-4495-8e1a-5fe6dac31906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.071667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6824623-256b-4495-8e1a-5fe6dac31906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.072411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6824623-256b-4495-8e1a-5fe6dac31906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:44.074039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6824623-256b-4495-8e1a-5fe6dac31906 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:44.085110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 989/1991] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:44.086266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6824623-256b-4495-8e1a-5fe6dac31906 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:44.090430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c6824623-256b-4495-8e1a-5fe6dac31906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:44.145071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbdc111c93a34e398119baed8eb07e28', 'request_id': 'req-076e2284-ec51-499c-9b37-9caa3eeb1fe7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:44.186781 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6824623-256b-4495-8e1a-5fe6dac31906 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:44.236168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1c144-e56a-44b1-918e-e19136069b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:44.236788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1c144-e56a-44b1-918e-e19136069b34 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.237243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1c144-e56a-44b1-918e-e19136069b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.237522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1c144-e56a-44b1-918e-e19136069b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.298493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1c144-e56a-44b1-918e-e19136069b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:44.299869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1c144-e56a-44b1-918e-e19136069b34 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:44.310181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 990/1992] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:44.310939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1c144-e56a-44b1-918e-e19136069b34 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:44.321148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbdc111c93a34e398119baed8eb07e28', 'request_id': 'req-076e2284-ec51-499c-9b37-9caa3eeb1fe7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:44.327442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1c144-e56a-44b1-918e-e19136069b34 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:44.329840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbdc111c93a34e398119baed8eb07e28', 'request_id': 'req-076e2284-ec51-499c-9b37-9caa3eeb1fe7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:44.330209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bd55c-a91e-411a-ac56-240aed6c3bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:44.331051 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bd55c-a91e-411a-ac56-240aed6c3bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.331511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bd55c-a91e-411a-ac56-240aed6c3bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.331883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bd55c-a91e-411a-ac56-240aed6c3bc3 admin admin] PATH_INFO: `/v3/projects/27a9d814eae0467e97e57f1f90e10546/users/92aac84e2287446f9839a8ff6fac1374/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.345582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] The token cache is being invalidate because project fbdc111c93a34e398119baed8eb07e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:44.346121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:44.347041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-076e2284-ec51-499c-9b37-9caa3eeb1fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:44.350831 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1003/1993] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:43 2022] DELETE /identity/v3/projects/fbdc111c93a34e398119baed8eb07e28 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:44.355618 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c7a1c-c36a-43de-9dbf-80d04a7b6f80 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.361522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c7a1c-c36a-43de-9dbf-80d04a7b6f80 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.361640 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bd55c-a91e-411a-ac56-240aed6c3bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a9d814eae0467e97e57f1f90e10546, user_id=92aac84e2287446f9839a8ff6fac1374, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:44.361739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c7a1c-c36a-43de-9dbf-80d04a7b6f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.362041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bd55c-a91e-411a-ac56-240aed6c3bc3 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:44.381706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fd7c7a1c-c36a-43de-9dbf-80d04a7b6f80 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:44.383047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fd7c7a1c-c36a-43de-9dbf-80d04a7b6f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:44.392528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1004/1994] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:44.400741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240079b5-17b5-45f8-9ff1-ace53f3d66b3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.401061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240079b5-17b5-45f8-9ff1-ace53f3d66b3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.401344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240079b5-17b5-45f8-9ff1-ace53f3d66b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.420828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:44.422151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-240079b5-17b5-45f8-9ff1-ace53f3d66b3 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:44.423500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-240079b5-17b5-45f8-9ff1-ace53f3d66b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:44.431897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1005/1995] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:44.439597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240079b5-17b5-45f8-9ff1-ace53f3d66b3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:44.448938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240079b5-17b5-45f8-9ff1-ace53f3d66b3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:44.453659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79144d-13ef-44d5-8c79-67997ab23584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:44.454268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79144d-13ef-44d5-8c79-67997ab23584 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.454544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79144d-13ef-44d5-8c79-67997ab23584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.454813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79144d-13ef-44d5-8c79-67997ab23584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.455532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79144d-13ef-44d5-8c79-67997ab23584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:44.455863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79144d-13ef-44d5-8c79-67997ab23584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:44.457498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79144d-13ef-44d5-8c79-67997ab23584 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:44.470486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 991/1996] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:44 2022] PUT /identity/v3/projects/27a9d814eae0467e97e57f1f90e10546/users/92aac84e2287446f9839a8ff6fac1374/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:44.485086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30bb2e-d27e-49bc-97c9-4f76697bcd42 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.485382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30bb2e-d27e-49bc-97c9-4f76697bcd42 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.486507 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30bb2e-d27e-49bc-97c9-4f76697bcd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.491477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1006/1997] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:09:44.495796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:44.497343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79144d-13ef-44d5-8c79-67997ab23584 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:44.516227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79144d-13ef-44d5-8c79-67997ab23584 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:44.527845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-eb30bb2e-d27e-49bc-97c9-4f76697bcd42 None None] MFA Rules not processed for user `92aac84e2287446f9839a8ff6fac1374`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:44.529447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-eb30bb2e-d27e-49bc-97c9-4f76697bcd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:44.582194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09c534-38b4-40d5-bef1-b6513b5885a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:44.582810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09c534-38b4-40d5-bef1-b6513b5885a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.583143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09c534-38b4-40d5-bef1-b6513b5885a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.583925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09c534-38b4-40d5-bef1-b6513b5885a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.584586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09c534-38b4-40d5-bef1-b6513b5885a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:44.586776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09c534-38b4-40d5-bef1-b6513b5885a3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:44.600436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 992/1998] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:44.607965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30bb2e-d27e-49bc-97c9-4f76697bcd42 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:44.613757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-eb30bb2e-d27e-49bc-97c9-4f76697bcd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:44.626421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30bb2e-d27e-49bc-97c9-4f76697bcd42 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:44.631475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a65c0-e95c-448e-b2be-62bd885a0bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:44.632086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a65c0-e95c-448e-b2be-62bd885a0bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.632364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a65c0-e95c-448e-b2be-62bd885a0bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.632635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a65c0-e95c-448e-b2be-62bd885a0bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.633387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a65c0-e95c-448e-b2be-62bd885a0bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:44.635281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a65c0-e95c-448e-b2be-62bd885a0bc3 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:44.753465 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1007/1999] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:44 2022] POST /identity/v3/projects => generated 391 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:44.757911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09c534-38b4-40d5-bef1-b6513b5885a3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:44.794407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 993/2000] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:44 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:44.799170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a65c0-e95c-448e-b2be-62bd885a0bc3 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:44.866128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09c534-38b4-40d5-bef1-b6513b5885a3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:44.906243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a65c0-e95c-448e-b2be-62bd885a0bc3 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:44.911819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faebdf-3a40-4c57-a331-6559859cb0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:44.912434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faebdf-3a40-4c57-a331-6559859cb0fc admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.912714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faebdf-3a40-4c57-a331-6559859cb0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.913018 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85faebdf-3a40-4c57-a331-6559859cb0fc admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.913676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faebdf-3a40-4c57-a331-6559859cb0fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:44.915724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85faebdf-3a40-4c57-a331-6559859cb0fc admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:44.928125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081713bd-a256-4443-b2eb-f203a0d80b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:44.928747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081713bd-a256-4443-b2eb-f203a0d80b4f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:44.929130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081713bd-a256-4443-b2eb-f203a0d80b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:44.929408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081713bd-a256-4443-b2eb-f203a0d80b4f admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:44.930078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081713bd-a256-4443-b2eb-f203a0d80b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:44.932142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081713bd-a256-4443-b2eb-f203a0d80b4f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.031510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 994/2001] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:44 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:45.035870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faebdf-3a40-4c57-a331-6559859cb0fc admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.038762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-85faebdf-3a40-4c57-a331-6559859cb0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:45.063756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1008/2002] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:44 2022] POST /identity/v3/users => generated 296 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:45.067887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081713bd-a256-4443-b2eb-f203a0d80b4f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.076291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85faebdf-3a40-4c57-a331-6559859cb0fc admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:45.088264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:45.089139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.089340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081713bd-a256-4443-b2eb-f203a0d80b4f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:45.089450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.089695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] PATH_INFO: `/v3/projects/b2cecf98dbee467185d324169e872603` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.092453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2cecf98dbee467185d324169e872603)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:45.093272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.096649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb511-891d-4686-b3ca-7b299f166cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:45.097427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb511-891d-4686-b3ca-7b299f166cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.097696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb511-891d-4686-b3ca-7b299f166cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.097978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb511-891d-4686-b3ca-7b299f166cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.098832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcb511-891d-4686-b3ca-7b299f166cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:45.101249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcb511-891d-4686-b3ca-7b299f166cb7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.113147 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1009/2003] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:45.113985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb511-891d-4686-b3ca-7b299f166cb7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.125936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb511-891d-4686-b3ca-7b299f166cb7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:45.132726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888433e4-2121-4d7b-9ed9-af96318bf85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:45.133564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888433e4-2121-4d7b-9ed9-af96318bf85c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.133900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888433e4-2121-4d7b-9ed9-af96318bf85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.134235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888433e4-2121-4d7b-9ed9-af96318bf85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.135004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888433e4-2121-4d7b-9ed9-af96318bf85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:45.136656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888433e4-2121-4d7b-9ed9-af96318bf85c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.152186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1010/2004] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:45.152186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888433e4-2121-4d7b-9ed9-af96318bf85c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.164444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888433e4-2121-4d7b-9ed9-af96318bf85c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:45.169583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fc9b0-2a77-4fc6-b7a2-2a8a064301ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:45.170297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fc9b0-2a77-4fc6-b7a2-2a8a064301ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.170573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fc9b0-2a77-4fc6-b7a2-2a8a064301ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.170843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fc9b0-2a77-4fc6-b7a2-2a8a064301ad admin admin] PATH_INFO: `/v3/projects/a0bc85e1df6241aba93428dd74de2703/users/be5cb8447d0b4eacafb45ddd7db665c3/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.188454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fc9b0-2a77-4fc6-b7a2-2a8a064301ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc85e1df6241aba93428dd74de2703, user_id=be5cb8447d0b4eacafb45ddd7db665c3, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:45.191696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fc9b0-2a77-4fc6-b7a2-2a8a064301ad admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.348709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1011/2005] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:45 2022] PUT /identity/v3/projects/a0bc85e1df6241aba93428dd74de2703/users/be5cb8447d0b4eacafb45ddd7db665c3/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:45.353284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fc9b0-2a77-4fc6-b7a2-2a8a064301ad admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.378351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cecf98dbee467185d324169e872603', 'request_id': 'req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:45.387539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cecf98dbee467185d324169e872603', 'request_id': 'req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:45.446468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fc9b0-2a77-4fc6-b7a2-2a8a064301ad admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:45.507328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad6364-4f8b-453e-a644-a932321951f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:45.508049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad6364-4f8b-453e-a644-a932321951f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.508428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad6364-4f8b-453e-a644-a932321951f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.508967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad6364-4f8b-453e-a644-a932321951f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.509753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad6364-4f8b-453e-a644-a932321951f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:45.511640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad6364-4f8b-453e-a644-a932321951f9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.520046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cecf98dbee467185d324169e872603', 'request_id': 'req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:45.522982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1012/2006] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:45.524119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad6364-4f8b-453e-a644-a932321951f9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.541077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad6364-4f8b-453e-a644-a932321951f9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:45.545952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d91cf-ba7a-4875-a33c-041c66f4da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:45.546581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d91cf-ba7a-4875-a33c-041c66f4da24 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.546859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d91cf-ba7a-4875-a33c-041c66f4da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.547130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d91cf-ba7a-4875-a33c-041c66f4da24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.559148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d91cf-ba7a-4875-a33c-041c66f4da24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:45.559148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d91cf-ba7a-4875-a33c-041c66f4da24 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.559493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] The token cache is being invalidate because project b2cecf98dbee467185d324169e872603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:45.559493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:45.563359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1013/2007] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:45.564430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:45.567688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d91cf-ba7a-4875-a33c-041c66f4da24 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.569236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 995/2008] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:45 2022] DELETE /identity/v3/projects/b2cecf98dbee467185d324169e872603 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:45.570242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.570731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-014d91cf-ba7a-4875-a33c-041c66f4da24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:45.572934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:45.584936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d91cf-ba7a-4875-a33c-041c66f4da24 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:45.588080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73fcf6-4b0f-4ca1-ba3b-d346f7dda93d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:45.590003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d3188-f091-4b79-b82a-a3441f107d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:45.590851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3188-f091-4b79-b82a-a3441f107d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.591142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3188-f091-4b79-b82a-a3441f107d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.591418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3188-f091-4b79-b82a-a3441f107d2d admin admin] PATH_INFO: `/v3/projects/44649d927a83424393a74c676f799580/users/2ad59874fcd84278aaeef930baedd414/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.593416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719007-f072-41b7-8e3e-a31e6f5fbef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:45.594015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719007-f072-41b7-8e3e-a31e6f5fbef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.594363 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719007-f072-41b7-8e3e-a31e6f5fbef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.594715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719007-f072-41b7-8e3e-a31e6f5fbef0 admin admin] PATH_INFO: `/v3/projects/a0bc85e1df6241aba93428dd74de2703/users/be5cb8447d0b4eacafb45ddd7db665c3/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.597080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8719007-f072-41b7-8e3e-a31e6f5fbef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc85e1df6241aba93428dd74de2703, user_id=be5cb8447d0b4eacafb45ddd7db665c3, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:45.600482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8719007-f072-41b7-8e3e-a31e6f5fbef0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.608611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d3188-f091-4b79-b82a-a3441f107d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44649d927a83424393a74c676f799580, user_id=2ad59874fcd84278aaeef930baedd414, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:45.611347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d3188-f091-4b79-b82a-a3441f107d2d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.612103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 996/2009] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:45 2022] PUT /identity/v3/projects/a0bc85e1df6241aba93428dd74de2703/users/be5cb8447d0b4eacafb45ddd7db665c3/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:45.612758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719007-f072-41b7-8e3e-a31e6f5fbef0 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.614457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a8719007-f072-41b7-8e3e-a31e6f5fbef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:45.681448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719007-f072-41b7-8e3e-a31e6f5fbef0 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:45.686630 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:45.687524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.687838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.688071 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] PATH_INFO: `/v3/users/d7e41ff6b10241c0ba1a116508b69145` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.690207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e41ff6b10241c0ba1a116508b69145)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:45.692353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:45.726667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1014/2010] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:45 2022] PUT /identity/v3/projects/44649d927a83424393a74c676f799580/users/2ad59874fcd84278aaeef930baedd414/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:45.727649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc3de4-7a26-4a97-b37c-a4870e160d35 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.728034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc3de4-7a26-4a97-b37c-a4870e160d35 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.728382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc3de4-7a26-4a97-b37c-a4870e160d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.758774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-54cc3de4-7a26-4a97-b37c-a4870e160d35 None None] MFA Rules not processed for user `be5cb8447d0b4eacafb45ddd7db665c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:45.760146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-54cc3de4-7a26-4a97-b37c-a4870e160d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:45.841357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1015/2011] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:45.842470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86cf95-f7be-417e-9fc0-5aacadc33597 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:45.842760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86cf95-f7be-417e-9fc0-5aacadc33597 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:45.843037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86cf95-f7be-417e-9fc0-5aacadc33597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:45.874367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6b86cf95-f7be-417e-9fc0-5aacadc33597 None None] MFA Rules not processed for user `2ad59874fcd84278aaeef930baedd414`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:45.876437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6b86cf95-f7be-417e-9fc0-5aacadc33597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:45.959730 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1016/2012] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:45.961032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86cf95-f7be-417e-9fc0-5aacadc33597 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:45.963084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6b86cf95-f7be-417e-9fc0-5aacadc33597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:46.027369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86cf95-f7be-417e-9fc0-5aacadc33597 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:46.033534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86268a-7e31-4f1b-9a8b-7a531eb46b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:46.034878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86268a-7e31-4f1b-9a8b-7a531eb46b58 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:46.035228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86268a-7e31-4f1b-9a8b-7a531eb46b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:46.035591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86268a-7e31-4f1b-9a8b-7a531eb46b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:46.047844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86268a-7e31-4f1b-9a8b-7a531eb46b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:46.049379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86268a-7e31-4f1b-9a8b-7a531eb46b58 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:46.066129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1017/2013] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:46.081523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86268a-7e31-4f1b-9a8b-7a531eb46b58 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:46.088932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e41ff6b10241c0ba1a116508b69145'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:46.089744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e41ff6b10241c0ba1a116508b69145'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:46.146554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86268a-7e31-4f1b-9a8b-7a531eb46b58 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:46.152180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b947a2e-41c8-4b33-aae5-f4141e6fd56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:46.152826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b947a2e-41c8-4b33-aae5-f4141e6fd56e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:46.153404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b947a2e-41c8-4b33-aae5-f4141e6fd56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:46.153979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b947a2e-41c8-4b33-aae5-f4141e6fd56e admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:46.154706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b947a2e-41c8-4b33-aae5-f4141e6fd56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:46.156705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b947a2e-41c8-4b33-aae5-f4141e6fd56e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:46.300410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e41ff6b10241c0ba1a116508b69145'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:46.301073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e41ff6b10241c0ba1a116508b69145'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:46.329541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e41ff6b10241c0ba1a116508b69145'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:46.361031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 997/2014] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:45 2022] DELETE /identity/v3/users/d7e41ff6b10241c0ba1a116508b69145 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:46.390927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1018/2015] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:46 2022] POST /identity/v3/projects => generated 393 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:46.395027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:46.396600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:46.523196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c21d3-850b-4aec-a212-8e40322a0d50 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:46.663881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2241743-2bd1-4296-9c51-158507a745c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:46.664538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2241743-2bd1-4296-9c51-158507a745c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:46.664855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2241743-2bd1-4296-9c51-158507a745c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:46.665247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2241743-2bd1-4296-9c51-158507a745c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:46.665831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2241743-2bd1-4296-9c51-158507a745c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:46.675156 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2241743-2bd1-4296-9c51-158507a745c8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:46.873326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 998/2016] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:46 2022] POST /identity/v3/users => generated 303 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:46.876859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b947a2e-41c8-4b33-aae5-f4141e6fd56e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:46.908191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b947a2e-41c8-4b33-aae5-f4141e6fd56e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:46.916232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:46.921357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121617-2950-47ba-b47d-88a6fecba329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:46.922266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121617-2950-47ba-b47d-88a6fecba329 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:46.923413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121617-2950-47ba-b47d-88a6fecba329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:46.923852 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121617-2950-47ba-b47d-88a6fecba329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:46.926351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25121617-2950-47ba-b47d-88a6fecba329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:46.929317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25121617-2950-47ba-b47d-88a6fecba329 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:46.948086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2241743-2bd1-4296-9c51-158507a745c8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:46.959078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1019/2017] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:46.959290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2241743-2bd1-4296-9c51-158507a745c8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:46.964538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d74829-c326-4920-bae5-b58085e1d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:46.965443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74829-c326-4920-bae5-b58085e1d22e admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:46.974173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74829-c326-4920-bae5-b58085e1d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:46.974173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74829-c326-4920-bae5-b58085e1d22e admin admin] PATH_INFO: `/v3/projects/6e0797f3d20744a6a5e6fff21ea74330/users/befd53ea7c344823a8045924db378026/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:46.977526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121617-2950-47ba-b47d-88a6fecba329 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:46.980380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-25121617-2950-47ba-b47d-88a6fecba329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:47.002382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25121617-2950-47ba-b47d-88a6fecba329 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:47.004546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d74829-c326-4920-bae5-b58085e1d22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0797f3d20744a6a5e6fff21ea74330, user_id=befd53ea7c344823a8045924db378026, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:47.010271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d74829-c326-4920-bae5-b58085e1d22e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:47.016761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:47.019708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:47.019708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:47.019708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] PATH_INFO: `/v3/users/92aac84e2287446f9839a8ff6fac1374` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:47.021403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=92aac84e2287446f9839a8ff6fac1374)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:47.023689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:47.140099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 999/2018] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:46 2022] PUT /identity/v3/projects/6e0797f3d20744a6a5e6fff21ea74330/users/befd53ea7c344823a8045924db378026/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:47.141750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d74829-c326-4920-bae5-b58085e1d22e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:47.226926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d74829-c326-4920-bae5-b58085e1d22e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:47.234077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73537-800e-4ed6-93f8-098749d030ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:47.234594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73537-800e-4ed6-93f8-098749d030ed admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:47.234944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73537-800e-4ed6-93f8-098749d030ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:47.235267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73537-800e-4ed6-93f8-098749d030ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:47.235918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73537-800e-4ed6-93f8-098749d030ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:47.241687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73537-800e-4ed6-93f8-098749d030ed admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:47.261920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1000/2019] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:47.261920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73537-800e-4ed6-93f8-098749d030ed admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:47.265207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-41d73537-800e-4ed6-93f8-098749d030ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:47.279721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73537-800e-4ed6-93f8-098749d030ed admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:47.293353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:47.294035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:47.294333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:47.294581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] PATH_INFO: `/v3/projects/caebcbe1496343098c98f6db6e643e9f` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:47.295823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caebcbe1496343098c98f6db6e643e9f)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:47.298276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:47.348366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92aac84e2287446f9839a8ff6fac1374'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.350282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92aac84e2287446f9839a8ff6fac1374'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.357907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92aac84e2287446f9839a8ff6fac1374'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.358899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92aac84e2287446f9839a8ff6fac1374'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.372128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92aac84e2287446f9839a8ff6fac1374'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.508406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caebcbe1496343098c98f6db6e643e9f', 'request_id': 'req-422bc2b3-f42a-4d2b-9397-bc2f7096f153'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.515783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caebcbe1496343098c98f6db6e643e9f', 'request_id': 'req-422bc2b3-f42a-4d2b-9397-bc2f7096f153'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.606125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1020/2020] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:46 2022] DELETE /identity/v3/users/92aac84e2287446f9839a8ff6fac1374 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:47.607355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:47.611849 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:47.699466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caebcbe1496343098c98f6db6e643e9f', 'request_id': 'req-422bc2b3-f42a-4d2b-9397-bc2f7096f153'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.711738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d459493-2d5b-4d3c-a64f-47eb617b5a9a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:47.717080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] The token cache is being invalidate because project caebcbe1496343098c98f6db6e643e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:47.717375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.717486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f50fc-babc-474a-b657-4671081d102d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:47.718061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f50fc-babc-474a-b657-4671081d102d admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:47.718346 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f50fc-babc-474a-b657-4671081d102d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:47.718622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f50fc-babc-474a-b657-4671081d102d admin admin] PATH_INFO: `/v3/projects/6e0797f3d20744a6a5e6fff21ea74330/users/befd53ea7c344823a8045924db378026/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:47.719006 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-422bc2b3-f42a-4d2b-9397-bc2f7096f153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:47.720758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f50fc-babc-474a-b657-4671081d102d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0797f3d20744a6a5e6fff21ea74330, user_id=befd53ea7c344823a8045924db378026, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:47.724036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f50fc-babc-474a-b657-4671081d102d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:47.728983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1001/2021] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:47 2022] DELETE /identity/v3/projects/caebcbe1496343098c98f6db6e643e9f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:47.735545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cdb4e-3fa5-4604-8cdb-582dcf691107 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:47.736016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cdb4e-3fa5-4604-8cdb-582dcf691107 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:47.738473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cdb4e-3fa5-4604-8cdb-582dcf691107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:47.754818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1021/2022] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:47 2022] PUT /identity/v3/projects/6e0797f3d20744a6a5e6fff21ea74330/users/befd53ea7c344823a8045924db378026/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:47.756372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986effa7-9158-428b-90e7-d59c7e0867e1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:47.756769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986effa7-9158-428b-90e7-d59c7e0867e1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:47.757199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986effa7-9158-428b-90e7-d59c7e0867e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:47.784419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-986effa7-9158-428b-90e7-d59c7e0867e1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:47.792304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-986effa7-9158-428b-90e7-d59c7e0867e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:47.814282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-113cdb4e-3fa5-4604-8cdb-582dcf691107 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:47.817560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-113cdb4e-3fa5-4604-8cdb-582dcf691107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:47.876977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1022/2023] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:47.878649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36fabf-951d-4a9b-93db-5b867279a717 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:47.878941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36fabf-951d-4a9b-93db-5b867279a717 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:47.879219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36fabf-951d-4a9b-93db-5b867279a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:47.913406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2d36fabf-951d-4a9b-93db-5b867279a717 None None] MFA Rules not processed for user `befd53ea7c344823a8045924db378026`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:47.914759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2d36fabf-951d-4a9b-93db-5b867279a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:47.928951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1002/2024] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:47.930357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400616-b71f-4d33-89c7-925867c98e4b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:47.930633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400616-b71f-4d33-89c7-925867c98e4b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:47.930914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400616-b71f-4d33-89c7-925867c98e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:47.972002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9e400616-b71f-4d33-89c7-925867c98e4b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:47.974336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9e400616-b71f-4d33-89c7-925867c98e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:47.994799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1003/2025] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:47.996989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1023/2026] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:47.998066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400616-b71f-4d33-89c7-925867c98e4b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:47.999144 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36fabf-951d-4a9b-93db-5b867279a717 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:47.999516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9e400616-b71f-4d33-89c7-925867c98e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:48.018911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36fabf-951d-4a9b-93db-5b867279a717 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:48.025091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:48.025747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.026032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.026322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:48.027188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:48.027499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:48.029985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:48.056859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1024/2027] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:09:48.061519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:48.063045 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:48.089963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400616-b71f-4d33-89c7-925867c98e4b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:48.094130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6978e-bc67-45a0-8034-412d7287a240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:48.095335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6978e-bc67-45a0-8034-412d7287a240 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.095763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6978e-bc67-45a0-8034-412d7287a240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.096207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6978e-bc67-45a0-8034-412d7287a240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:48.107480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6978e-bc67-45a0-8034-412d7287a240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:48.109571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6978e-bc67-45a0-8034-412d7287a240 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:48.121142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1004/2028] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:48.122271 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6978e-bc67-45a0-8034-412d7287a240 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:48.134196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6978e-bc67-45a0-8034-412d7287a240 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:48.136439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:48.145030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500191-41a2-46cc-bca0-7062e6d0ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:48.146444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500191-41a2-46cc-bca0-7062e6d0ebba admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.153201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500191-41a2-46cc-bca0-7062e6d0ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.153201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500191-41a2-46cc-bca0-7062e6d0ebba admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:48.153201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500191-41a2-46cc-bca0-7062e6d0ebba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:48.153201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500191-41a2-46cc-bca0-7062e6d0ebba admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:48.195992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d70dfd-0a0f-452e-9a3b-10edf0bdbad6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:48.205404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b639f1-acc8-407f-8dda-88302cd3e20b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:48.206048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b639f1-acc8-407f-8dda-88302cd3e20b service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.206406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b639f1-acc8-407f-8dda-88302cd3e20b service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.206617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b639f1-acc8-407f-8dda-88302cd3e20b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:48.224875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b639f1-acc8-407f-8dda-88302cd3e20b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:48.226534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b639f1-acc8-407f-8dda-88302cd3e20b service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:48.238782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1025/2029] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:48.294071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b639f1-acc8-407f-8dda-88302cd3e20b service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:48.295933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d1b639f1-acc8-407f-8dda-88302cd3e20b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:48.315107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b639f1-acc8-407f-8dda-88302cd3e20b service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:48.318720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1005/2030] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:48 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:48.323389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500191-41a2-46cc-bca0-7062e6d0ebba admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:48.407710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02238323-7d0a-49f4-a0bc-5872d1b22a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:48.408437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02238323-7d0a-49f4-a0bc-5872d1b22a34 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.408709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02238323-7d0a-49f4-a0bc-5872d1b22a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.409065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02238323-7d0a-49f4-a0bc-5872d1b22a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:48.414686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-02238323-7d0a-49f4-a0bc-5872d1b22a34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:48.417831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500191-41a2-46cc-bca0-7062e6d0ebba admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:48.424424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10161c82-0f0f-42fd-a634-c77050891c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:48.425234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10161c82-0f0f-42fd-a634-c77050891c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.425620 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10161c82-0f0f-42fd-a634-c77050891c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.426080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10161c82-0f0f-42fd-a634-c77050891c22 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:48.426834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10161c82-0f0f-42fd-a634-c77050891c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:48.429997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10161c82-0f0f-42fd-a634-c77050891c22 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:48.496974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02238323-7d0a-49f4-a0bc-5872d1b22a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:48.499016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02238323-7d0a-49f4-a0bc-5872d1b22a34 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:48.514869 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1026/2031] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:48.551101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1006/2032] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:48 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:48.554911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02238323-7d0a-49f4-a0bc-5872d1b22a34 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:48.570145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02238323-7d0a-49f4-a0bc-5872d1b22a34 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:48.583909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69efd36-b8ce-4db7-8590-a848eea2c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:48.585192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69efd36-b8ce-4db7-8590-a848eea2c176 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.586198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69efd36-b8ce-4db7-8590-a848eea2c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.586954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69efd36-b8ce-4db7-8590-a848eea2c176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:48.587958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69efd36-b8ce-4db7-8590-a848eea2c176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:48.590263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69efd36-b8ce-4db7-8590-a848eea2c176 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:48.607755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1027/2033] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:48.611607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10161c82-0f0f-42fd-a634-c77050891c22 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:48.626111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10161c82-0f0f-42fd-a634-c77050891c22 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:48.637080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0dc58-62a6-4c45-8f92-c97b9347939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:48.638320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0dc58-62a6-4c45-8f92-c97b9347939e admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.638805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0dc58-62a6-4c45-8f92-c97b9347939e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.639386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0dc58-62a6-4c45-8f92-c97b9347939e admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:48.640409 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0dc58-62a6-4c45-8f92-c97b9347939e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:48.643982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0dc58-62a6-4c45-8f92-c97b9347939e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:48.665750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69efd36-b8ce-4db7-8590-a848eea2c176 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:48.666447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1007/2034] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:48.681409 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69efd36-b8ce-4db7-8590-a848eea2c176 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:48.688395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c4fe3-f872-4865-92b9-cf78294028a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:48.689220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c4fe3-f872-4865-92b9-cf78294028a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.689795 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c4fe3-f872-4865-92b9-cf78294028a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.690146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c4fe3-f872-4865-92b9-cf78294028a5 admin admin] PATH_INFO: `/v3/projects/fff8882aeef04eb1933495f112230dce/users/db43c578333940088543864c8a0e199d/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:48.723081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c4fe3-f872-4865-92b9-cf78294028a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff8882aeef04eb1933495f112230dce, user_id=db43c578333940088543864c8a0e199d, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:48.725888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c4fe3-f872-4865-92b9-cf78294028a5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:48.965252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1028/2035] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:48 2022] PUT /identity/v3/projects/fff8882aeef04eb1933495f112230dce/users/db43c578333940088543864c8a0e199d/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:48.977305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dea381-4606-41dd-be60-557e0c075558 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:48.977578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dea381-4606-41dd-be60-557e0c075558 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:48.977863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dea381-4606-41dd-be60-557e0c075558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:49.067147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-42dea381-4606-41dd-be60-557e0c075558 None None] MFA Rules not processed for user `db43c578333940088543864c8a0e199d`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:49.069020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-42dea381-4606-41dd-be60-557e0c075558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:49.221693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1008/2036] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:49.226522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c4fe3-f872-4865-92b9-cf78294028a5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:49.245711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dea381-4606-41dd-be60-557e0c075558 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:49.249585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-42dea381-4606-41dd-be60-557e0c075558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:49.348306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c4fe3-f872-4865-92b9-cf78294028a5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:49.354723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dea381-4606-41dd-be60-557e0c075558 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:49.356440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ba3c4-da25-4f89-aea9-908d4473fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:49.357432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ba3c4-da25-4f89-aea9-908d4473fcc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:49.357715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ba3c4-da25-4f89-aea9-908d4473fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:49.357988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ba3c4-da25-4f89-aea9-908d4473fcc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:49.358812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ba3c4-da25-4f89-aea9-908d4473fcc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:49.360324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:49.361290 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:49.361573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ba3c4-da25-4f89-aea9-908d4473fcc8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:49.361660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:49.361895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] PATH_INFO: `/v3/projects/27a9d814eae0467e97e57f1f90e10546` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:49.363176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a9d814eae0467e97e57f1f90e10546)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:49.365669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:49.500251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1029/2037] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:49 2022] POST /identity/v3/projects => generated 367 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:49.501331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ba3c4-da25-4f89-aea9-908d4473fcc8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:49.601886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ba3c4-da25-4f89-aea9-908d4473fcc8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:49.625569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a9d814eae0467e97e57f1f90e10546', 'request_id': 'req-9efcb173-2c39-4c44-ae59-080dd36cc532'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:49.634127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a9d814eae0467e97e57f1f90e10546', 'request_id': 'req-9efcb173-2c39-4c44-ae59-080dd36cc532'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:49.692804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:49.716775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a9d814eae0467e97e57f1f90e10546', 'request_id': 'req-9efcb173-2c39-4c44-ae59-080dd36cc532'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:49.735997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] The token cache is being invalidate because project 27a9d814eae0467e97e57f1f90e10546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:49.738233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:49.739885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91c9fe-076e-4fa7-8f6d-08c44f1a6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:49.740354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:49.740701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c9fe-076e-4fa7-8f6d-08c44f1a6564 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:49.741091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c9fe-076e-4fa7-8f6d-08c44f1a6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:49.742991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c9fe-076e-4fa7-8f6d-08c44f1a6564 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:49.745848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1009/2038] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:49 2022] DELETE /identity/v3/projects/27a9d814eae0467e97e57f1f90e10546 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:49.746181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91c9fe-076e-4fa7-8f6d-08c44f1a6564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:49.746951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:49.748343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91c9fe-076e-4fa7-8f6d-08c44f1a6564 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:49.750921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:49.809314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb173-2c39-4c44-ae59-080dd36cc532 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:49.821675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:49.822532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:49.822948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:49.823400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] PATH_INFO: `/v3/users/be5cb8447d0b4eacafb45ddd7db665c3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:49.825472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5cb8447d0b4eacafb45ddd7db665c3)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:49.829793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:49.898905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1030/2039] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:49 2022] POST /identity/v3/users => generated 290 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:49.900060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91c9fe-076e-4fa7-8f6d-08c44f1a6564 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:49.907940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fd91c9fe-076e-4fa7-8f6d-08c44f1a6564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:49.933951 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91c9fe-076e-4fa7-8f6d-08c44f1a6564 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:49.943677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c48a9-39fd-4ab8-bff7-90b259ffb2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:49.943677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c48a9-39fd-4ab8-bff7-90b259ffb2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:49.944233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c48a9-39fd-4ab8-bff7-90b259ffb2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:49.945180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c48a9-39fd-4ab8-bff7-90b259ffb2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:49.946015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c48a9-39fd-4ab8-bff7-90b259ffb2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:49.951124 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c48a9-39fd-4ab8-bff7-90b259ffb2c6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:49.984749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1031/2040] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:49.991054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c48a9-39fd-4ab8-bff7-90b259ffb2c6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:50.024648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c48a9-39fd-4ab8-bff7-90b259ffb2c6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:50.030151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33490b2-104c-4ab5-b550-1b15c5cd6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:50.031273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33490b2-104c-4ab5-b550-1b15c5cd6564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:50.033438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33490b2-104c-4ab5-b550-1b15c5cd6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:50.034272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33490b2-104c-4ab5-b550-1b15c5cd6564 admin admin] PATH_INFO: `/v3/projects/f9e3eeb64c1c4dc3b9526394e9d8107b/users/36fbbed4433e42f1b65780b61019d383/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:50.063051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33490b2-104c-4ab5-b550-1b15c5cd6564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e3eeb64c1c4dc3b9526394e9d8107b, user_id=36fbbed4433e42f1b65780b61019d383, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:50.066000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33490b2-104c-4ab5-b550-1b15c5cd6564 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:50.108212 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5cb8447d0b4eacafb45ddd7db665c3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:50.110147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5cb8447d0b4eacafb45ddd7db665c3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:50.230552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1032/2041] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:49 2022] PUT /identity/v3/projects/f9e3eeb64c1c4dc3b9526394e9d8107b/users/36fbbed4433e42f1b65780b61019d383/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:50.234562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33490b2-104c-4ab5-b550-1b15c5cd6564 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:50.242558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5cb8447d0b4eacafb45ddd7db665c3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:50.244412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5cb8447d0b4eacafb45ddd7db665c3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:50.268356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4367967a-7a77-43b6-8253-97cca0a0ebd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5cb8447d0b4eacafb45ddd7db665c3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:50.296323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1010/2042] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:49 2022] DELETE /identity/v3/users/be5cb8447d0b4eacafb45ddd7db665c3 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:50.298077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fb81f-ccab-4e11-acee-97c11a92572c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:50.298467 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fb81f-ccab-4e11-acee-97c11a92572c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:50.298809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fb81f-ccab-4e11-acee-97c11a92572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:50.341572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33490b2-104c-4ab5-b550-1b15c5cd6564 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:50.380344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c50fb81f-ccab-4e11-acee-97c11a92572c None None] MFA Rules not processed for user `7b48b352a5514bab8651977f5f9ef040`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:50.381676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c50fb81f-ccab-4e11-acee-97c11a92572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:50.407353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7ef4-4377-4b6d-bd0e-a14f925b332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:50.408135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7ef4-4377-4b6d-bd0e-a14f925b332f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:50.408544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7ef4-4377-4b6d-bd0e-a14f925b332f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:50.408870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7ef4-4377-4b6d-bd0e-a14f925b332f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:50.410061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc7ef4-4377-4b6d-bd0e-a14f925b332f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:50.411757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc7ef4-4377-4b6d-bd0e-a14f925b332f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:50.426569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1033/2043] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:50.427631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7ef4-4377-4b6d-bd0e-a14f925b332f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:50.430174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aacc7ef4-4377-4b6d-bd0e-a14f925b332f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:50.446631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7ef4-4377-4b6d-bd0e-a14f925b332f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:50.451866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e3459-6b82-4d58-b0da-5d07bba6878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:50.452545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e3459-6b82-4d58-b0da-5d07bba6878f admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:50.452854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e3459-6b82-4d58-b0da-5d07bba6878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:50.453340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e3459-6b82-4d58-b0da-5d07bba6878f admin admin] PATH_INFO: `/v3/projects/f9e3eeb64c1c4dc3b9526394e9d8107b/users/36fbbed4433e42f1b65780b61019d383/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:50.455408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e3459-6b82-4d58-b0da-5d07bba6878f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e3eeb64c1c4dc3b9526394e9d8107b, user_id=36fbbed4433e42f1b65780b61019d383, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:50.458884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e3459-6b82-4d58-b0da-5d07bba6878f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:50.470878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1034/2044] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:50 2022] PUT /identity/v3/projects/f9e3eeb64c1c4dc3b9526394e9d8107b/users/36fbbed4433e42f1b65780b61019d383/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:50.482881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e837e-fb7a-4d6c-9f9f-8afac8792369 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:50.483316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e837e-fb7a-4d6c-9f9f-8afac8792369 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:50.483803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e837e-fb7a-4d6c-9f9f-8afac8792369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:50.496100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1011/2045] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:50.507829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1e44-56fa-49cc-bcbe-fd9b5dea197d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:50.508204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1e44-56fa-49cc-bcbe-fd9b5dea197d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:50.508756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a1e44-56fa-49cc-bcbe-fd9b5dea197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:50.520209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-705e837e-fb7a-4d6c-9f9f-8afac8792369 None None] MFA Rules not processed for user `36fbbed4433e42f1b65780b61019d383`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:50.522125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-705e837e-fb7a-4d6c-9f9f-8afac8792369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:50.531083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-870a1e44-56fa-49cc-bcbe-fd9b5dea197d None None] MFA Rules not processed for user `7b48b352a5514bab8651977f5f9ef040`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:50.532833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-870a1e44-56fa-49cc-bcbe-fd9b5dea197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:50.607486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1012/2046] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:50.612914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1035/2047] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:50.624543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1e44-56fa-49cc-bcbe-fd9b5dea197d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:50.624868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e837e-fb7a-4d6c-9f9f-8afac8792369 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:50.626292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-705e837e-fb7a-4d6c-9f9f-8afac8792369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:50.627137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-870a1e44-56fa-49cc-bcbe-fd9b5dea197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:50.652207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:50.690841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e837e-fb7a-4d6c-9f9f-8afac8792369 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:50.697557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f5c3e-fafd-4ade-9c8a-47c927cd2f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:50.698167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f5c3e-fafd-4ade-9c8a-47c927cd2f7b service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:50.698448 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f5c3e-fafd-4ade-9c8a-47c927cd2f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:50.698734 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f5c3e-fafd-4ade-9c8a-47c927cd2f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:50.713255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f5c3e-fafd-4ade-9c8a-47c927cd2f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:50.714766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f5c3e-fafd-4ade-9c8a-47c927cd2f7b service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:50.721150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a1e44-56fa-49cc-bcbe-fd9b5dea197d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:50.726365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1036/2048] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:09:50.730459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded38c03-f6e8-4309-96bf-760041229256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:50.732046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded38c03-f6e8-4309-96bf-760041229256 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:50.732548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded38c03-f6e8-4309-96bf-760041229256 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:50.733077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded38c03-f6e8-4309-96bf-760041229256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:50.761551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded38c03-f6e8-4309-96bf-760041229256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:50.766665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded38c03-f6e8-4309-96bf-760041229256 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:50.785047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1013/2049] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:50.915734 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f5c3e-fafd-4ade-9c8a-47c927cd2f7b service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:50.926319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f5c3e-fafd-4ade-9c8a-47c927cd2f7b service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:50.930571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44642ca-9f81-4dfa-b459-9c78c6b8c104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:50.931210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44642ca-9f81-4dfa-b459-9c78c6b8c104 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:50.931491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44642ca-9f81-4dfa-b459-9c78c6b8c104 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:50.933826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44642ca-9f81-4dfa-b459-9c78c6b8c104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:50.933826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f44642ca-9f81-4dfa-b459-9c78c6b8c104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:51.011789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44642ca-9f81-4dfa-b459-9c78c6b8c104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:51.013318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44642ca-9f81-4dfa-b459-9c78c6b8c104 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:51.023706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1037/2050] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:51.338528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded38c03-f6e8-4309-96bf-760041229256 service nova] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:51.340419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ded38c03-f6e8-4309-96bf-760041229256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:51.455622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded38c03-f6e8-4309-96bf-760041229256 service nova] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:51.463390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:51.464525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:51.465738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:51.466622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] PATH_INFO: `/v3/projects/a0bc85e1df6241aba93428dd74de2703` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:51.467940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bc85e1df6241aba93428dd74de2703)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:51.470061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:51.598436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bc85e1df6241aba93428dd74de2703', 'request_id': 'req-ac35706e-5500-4ede-8c17-79e632819c88'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:51.605070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bc85e1df6241aba93428dd74de2703', 'request_id': 'req-ac35706e-5500-4ede-8c17-79e632819c88'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:51.711334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bc85e1df6241aba93428dd74de2703', 'request_id': 'req-ac35706e-5500-4ede-8c17-79e632819c88'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:51.730637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] The token cache is being invalidate because project a0bc85e1df6241aba93428dd74de2703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:51.730944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:51.733460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ac35706e-5500-4ede-8c17-79e632819c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:51.740449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1014/2051] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:51 2022] DELETE /identity/v3/projects/a0bc85e1df6241aba93428dd74de2703 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:51.741675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5e36e-b96d-4cef-98d5-1fc5c7781bbb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:51.742133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5e36e-b96d-4cef-98d5-1fc5c7781bbb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:51.742250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5e36e-b96d-4cef-98d5-1fc5c7781bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:51.765013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-19d5e36e-b96d-4cef-98d5-1fc5c7781bbb None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:51.766339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-19d5e36e-b96d-4cef-98d5-1fc5c7781bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:51.835450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1038/2052] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:51.843894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391095e4-5193-48fb-831b-c48278fa9653 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:51.844401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391095e4-5193-48fb-831b-c48278fa9653 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:51.844873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391095e4-5193-48fb-831b-c48278fa9653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:51.881635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-391095e4-5193-48fb-831b-c48278fa9653 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:51.882941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-391095e4-5193-48fb-831b-c48278fa9653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:51.903099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1015/2053] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:51.907472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5e36e-b96d-4cef-98d5-1fc5c7781bbb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:51.935495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5e36e-b96d-4cef-98d5-1fc5c7781bbb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:51.948988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615fafe-0b8e-4878-a0a8-29ce681f2d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:51.950221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615fafe-0b8e-4878-a0a8-29ce681f2d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:51.963978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615fafe-0b8e-4878-a0a8-29ce681f2d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:51.966537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615fafe-0b8e-4878-a0a8-29ce681f2d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:51.967589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615fafe-0b8e-4878-a0a8-29ce681f2d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:51.968802 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615fafe-0b8e-4878-a0a8-29ce681f2d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:51.975370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615fafe-0b8e-4878-a0a8-29ce681f2d48 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:52.000575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1039/2054] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:09:52.001661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391095e4-5193-48fb-831b-c48278fa9653 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:52.018616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391095e4-5193-48fb-831b-c48278fa9653 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:52.029315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab746c-a505-4608-aa48-2ed0fba0ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:52.033794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab746c-a505-4608-aa48-2ed0fba0ef21 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:52.034199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab746c-a505-4608-aa48-2ed0fba0ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:52.034767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab746c-a505-4608-aa48-2ed0fba0ef21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:52.035941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab746c-a505-4608-aa48-2ed0fba0ef21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:52.043606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab746c-a505-4608-aa48-2ed0fba0ef21 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:52.082210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf320423-266a-4adf-a743-c5662f4d3bfb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:52.082210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf320423-266a-4adf-a743-c5662f4d3bfb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:52.082210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf320423-266a-4adf-a743-c5662f4d3bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:52.102657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cf320423-266a-4adf-a743-c5662f4d3bfb None None] MFA Rules not processed for user `7b48b352a5514bab8651977f5f9ef040`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:52.104112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cf320423-266a-4adf-a743-c5662f4d3bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:52.186261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1016/2055] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:52 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:52.190688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab746c-a505-4608-aa48-2ed0fba0ef21 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:52.207791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1040/2056] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:52.281361 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab746c-a505-4608-aa48-2ed0fba0ef21 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:52.287729 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5211-ed51-42ac-ab70-43f5bd01bfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:52.288367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5211-ed51-42ac-ab70-43f5bd01bfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:52.288699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5211-ed51-42ac-ab70-43f5bd01bfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:52.289073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5211-ed51-42ac-ab70-43f5bd01bfb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:52.295336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f5211-ed51-42ac-ab70-43f5bd01bfb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:52.297344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f5211-ed51-42ac-ab70-43f5bd01bfb7 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:52.407807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1017/2057] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:52 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:09:52.408972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf320423-266a-4adf-a743-c5662f4d3bfb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:52.420578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf320423-266a-4adf-a743-c5662f4d3bfb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:52.432062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ca457-4e8b-43d7-a6d7-d7a0aa47add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:52.432887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ca457-4e8b-43d7-a6d7-d7a0aa47add6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:52.433173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ca457-4e8b-43d7-a6d7-d7a0aa47add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:52.433451 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ca457-4e8b-43d7-a6d7-d7a0aa47add6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:52.434170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ca457-4e8b-43d7-a6d7-d7a0aa47add6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:52.435868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ca457-4e8b-43d7-a6d7-d7a0aa47add6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:52.454476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5211-ed51-42ac-ab70-43f5bd01bfb7 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:52.461839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1041/2058] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:52.466324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f5211-ed51-42ac-ab70-43f5bd01bfb7 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:52.476803 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379a020-222e-431d-9022-e435c4f0e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:52.477530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379a020-222e-431d-9022-e435c4f0e69e admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:52.477930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379a020-222e-431d-9022-e435c4f0e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:52.478274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379a020-222e-431d-9022-e435c4f0e69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:52.480738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379a020-222e-431d-9022-e435c4f0e69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:52.482726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379a020-222e-431d-9022-e435c4f0e69e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:52.499199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ca457-4e8b-43d7-a6d7-d7a0aa47add6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:52.506767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1018/2059] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:09:52.511302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ca457-4e8b-43d7-a6d7-d7a0aa47add6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:52.517497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd169fa-76c4-4a3c-971e-1460757bf258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:52.518354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd169fa-76c4-4a3c-971e-1460757bf258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:52.518686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd169fa-76c4-4a3c-971e-1460757bf258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:52.518967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd169fa-76c4-4a3c-971e-1460757bf258 admin admin] PATH_INFO: `/v3/projects/81e0a5bfe13747428f08211015b716a3/users/9ba91b008b0f40bb9f243c4933b24a8e/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:52.534670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd169fa-76c4-4a3c-971e-1460757bf258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e0a5bfe13747428f08211015b716a3, user_id=9ba91b008b0f40bb9f243c4933b24a8e, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:52.537455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd169fa-76c4-4a3c-971e-1460757bf258 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:52.672566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1042/2060] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:52 2022] PUT /identity/v3/projects/81e0a5bfe13747428f08211015b716a3/users/9ba91b008b0f40bb9f243c4933b24a8e/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:52.677809 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d28e-d452-4ac1-887e-2ce56b022cc5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:52.678344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d28e-d452-4ac1-887e-2ce56b022cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:52.678772 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d28e-d452-4ac1-887e-2ce56b022cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:52.733982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-54a1d28e-d452-4ac1-887e-2ce56b022cc5 None None] MFA Rules not processed for user `9ba91b008b0f40bb9f243c4933b24a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:52.742614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-54a1d28e-d452-4ac1-887e-2ce56b022cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:52.835492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:52.865301 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1019/2061] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:52.877160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd169fa-76c4-4a3c-971e-1460757bf258 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:52.884517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3dd169fa-76c4-4a3c-971e-1460757bf258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:53.016473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd169fa-76c4-4a3c-971e-1460757bf258 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:53.024200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676eaa54-d5eb-496e-8775-2e6eda9993f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:53.025967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eaa54-d5eb-496e-8775-2e6eda9993f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:53.025967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eaa54-d5eb-496e-8775-2e6eda9993f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:53.025967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eaa54-d5eb-496e-8775-2e6eda9993f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:53.050150 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676eaa54-d5eb-496e-8775-2e6eda9993f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:53.052097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676eaa54-d5eb-496e-8775-2e6eda9993f5 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:53.095147 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1043/2062] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:54.326538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:55.315536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d28e-d452-4ac1-887e-2ce56b022cc5 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:55.317785 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-54a1d28e-d452-4ac1-887e-2ce56b022cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:55.398185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d28e-d452-4ac1-887e-2ce56b022cc5 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:55.402975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:55.403697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:55.404046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:55.404323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] PATH_INFO: `/v3/users/2ad59874fcd84278aaeef930baedd414` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:55.405676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad59874fcd84278aaeef930baedd414)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:55.407667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:55.747929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad59874fcd84278aaeef930baedd414'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:55.748592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad59874fcd84278aaeef930baedd414'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:55.893415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad59874fcd84278aaeef930baedd414'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:55.894090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad59874fcd84278aaeef930baedd414'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:55.907532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad59874fcd84278aaeef930baedd414'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:55.920750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1020/2063] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:55 2022] DELETE /identity/v3/users/2ad59874fcd84278aaeef930baedd414 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:55.925267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49b24-60ea-4321-809d-88021c06f983 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:55.926130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49b24-60ea-4321-809d-88021c06f983 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:55.926638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a49b24-60ea-4321-809d-88021c06f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:55.948079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-53a49b24-60ea-4321-809d-88021c06f983 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:55.949648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-53a49b24-60ea-4321-809d-88021c06f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:56.015994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1044/2064] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:56.028180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:56.029774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:56.090591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cd757-1ee6-4371-af0b-fbab6273b447 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:56.094179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbbd9d-97fe-4d9d-98c4-7bab9070fb26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:56.094798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbbd9d-97fe-4d9d-98c4-7bab9070fb26 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:56.095078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbbd9d-97fe-4d9d-98c4-7bab9070fb26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:56.095468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbbd9d-97fe-4d9d-98c4-7bab9070fb26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:56.104722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbbd9d-97fe-4d9d-98c4-7bab9070fb26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:56.106211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbbd9d-97fe-4d9d-98c4-7bab9070fb26 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:56.116838 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1021/2065] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:56.880310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a49b24-60ea-4321-809d-88021c06f983 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:56.881988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-53a49b24-60ea-4321-809d-88021c06f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:56.900797 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a49b24-60ea-4321-809d-88021c06f983 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:56.910253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:56.911035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:56.911945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:56.912378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] PATH_INFO: `/v3/projects/44649d927a83424393a74c676f799580` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:56.913774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44649d927a83424393a74c676f799580)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:56.916020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:57.135534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44649d927a83424393a74c676f799580', 'request_id': 'req-e80c6e22-a8dc-4530-8791-9121e7b7da2e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.221219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbbd9d-97fe-4d9d-98c4-7bab9070fb26 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:57.222819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1abbbd9d-97fe-4d9d-98c4-7bab9070fb26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:57.236979 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbbd9d-97fe-4d9d-98c4-7bab9070fb26 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:57.259204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44649d927a83424393a74c676f799580', 'request_id': 'req-e80c6e22-a8dc-4530-8791-9121e7b7da2e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.266369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44649d927a83424393a74c676f799580', 'request_id': 'req-e80c6e22-a8dc-4530-8791-9121e7b7da2e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.279231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] The token cache is being invalidate because project 44649d927a83424393a74c676f799580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:57.279426 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.280090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.282048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1045/2066] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:56 2022] DELETE /identity/v3/projects/44649d927a83424393a74c676f799580 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:57.286677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:57.288549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:57.345366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:57.346485 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:57.347083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:57.347845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] PATH_INFO: `/v3/users/db43c578333940088543864c8a0e199d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:57.349415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db43c578333940088543864c8a0e199d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:57.351727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:57.370247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6e22-a8dc-4530-8791-9121e7b7da2e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:57.377767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:57.380877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:57.381292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:57.381580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] PATH_INFO: `/v3/users/befd53ea7c344823a8045924db378026` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:57.383378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=befd53ea7c344823a8045924db378026)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:57.385510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:57.690218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db43c578333940088543864c8a0e199d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.691034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db43c578333940088543864c8a0e199d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.777416 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'befd53ea7c344823a8045924db378026'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.778094 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'befd53ea7c344823a8045924db378026'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.788004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'befd53ea7c344823a8045924db378026'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.788365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'befd53ea7c344823a8045924db378026'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.801433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'befd53ea7c344823a8045924db378026'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.920874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db43c578333940088543864c8a0e199d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.921454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db43c578333940088543864c8a0e199d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.950188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4fb0891a-57db-4da4-9568-cc8087971c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db43c578333940088543864c8a0e199d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:57.962074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:57.969934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1022/2067] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:57 2022] DELETE /identity/v3/users/db43c578333940088543864c8a0e199d => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:57.977745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e31dd-7a2e-4d9d-a121-f36d30537901 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:57.979399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e31dd-7a2e-4d9d-a121-f36d30537901 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:57.979854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e31dd-7a2e-4d9d-a121-f36d30537901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:58.021999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-496e31dd-7a2e-4d9d-a121-f36d30537901 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:58.032823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-496e31dd-7a2e-4d9d-a121-f36d30537901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:58.065553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1046/2068] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:57 2022] DELETE /identity/v3/users/befd53ea7c344823a8045924db378026 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:58.149218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1023/2069] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:58.164578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:58.172304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:58.243981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d557444-ba1c-4669-8c55-b5140725ca89 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:58.247830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788c0c1-308e-4c29-bd0f-5c085ae53df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:58.248540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788c0c1-308e-4c29-bd0f-5c085ae53df7 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:58.248923 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788c0c1-308e-4c29-bd0f-5c085ae53df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:58.249262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788c0c1-308e-4c29-bd0f-5c085ae53df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:58.333498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788c0c1-308e-4c29-bd0f-5c085ae53df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:58.334932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788c0c1-308e-4c29-bd0f-5c085ae53df7 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:58.346443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1047/2070] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:09:58.850043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e31dd-7a2e-4d9d-a121-f36d30537901 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:58.851549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-496e31dd-7a2e-4d9d-a121-f36d30537901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:58.872189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e31dd-7a2e-4d9d-a121-f36d30537901 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:58.880628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:58.881878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:58.882733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:58.883241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] PATH_INFO: `/v3/projects/6e0797f3d20744a6a5e6fff21ea74330` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:58.884663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0797f3d20744a6a5e6fff21ea74330)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:58.894718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:58.965744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788c0c1-308e-4c29-bd0f-5c085ae53df7 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:58.966247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2788c0c1-308e-4c29-bd0f-5c085ae53df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:58.983960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788c0c1-308e-4c29-bd0f-5c085ae53df7 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:58.999205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:58.999860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.000138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.000504 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] PATH_INFO: `/v3/projects/fff8882aeef04eb1933495f112230dce` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.001725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff8882aeef04eb1933495f112230dce)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:59.003623 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:59.058356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0797f3d20744a6a5e6fff21ea74330', 'request_id': 'req-7a56957a-e527-42f7-8724-8882cb4b840a'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.065798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0797f3d20744a6a5e6fff21ea74330', 'request_id': 'req-7a56957a-e527-42f7-8724-8882cb4b840a'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.174454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:59.175372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0797f3d20744a6a5e6fff21ea74330', 'request_id': 'req-7a56957a-e527-42f7-8724-8882cb4b840a'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.189430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] The token cache is being invalidate because project 6e0797f3d20744a6a5e6fff21ea74330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:59.189721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.190385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7a56957a-e527-42f7-8724-8882cb4b840a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.192204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1024/2071] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:58 2022] DELETE /identity/v3/projects/6e0797f3d20744a6a5e6fff21ea74330 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:59.193352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff8882aeef04eb1933495f112230dce', 'request_id': 'req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.196807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2f74-4877-4c99-a5cd-460b4cc3304d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.197088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2f74-4877-4c99-a5cd-460b4cc3304d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.197362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf2f74-4877-4c99-a5cd-460b4cc3304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.219521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-44cf2f74-4877-4c99-a5cd-460b4cc3304d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:59.221390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-44cf2f74-4877-4c99-a5cd-460b4cc3304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:59.286983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1025/2072] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:09:59.295420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904b98-175c-470c-b22b-bdc2f5937d3e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.295725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904b98-175c-470c-b22b-bdc2f5937d3e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.295980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904b98-175c-470c-b22b-bdc2f5937d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.315696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9d904b98-175c-470c-b22b-bdc2f5937d3e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:09:59.316924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9d904b98-175c-470c-b22b-bdc2f5937d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:59.330956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1026/2073] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:09:59.332236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904b98-175c-470c-b22b-bdc2f5937d3e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:59.342429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff8882aeef04eb1933495f112230dce', 'request_id': 'req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.344768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904b98-175c-470c-b22b-bdc2f5937d3e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:59.350658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff8882aeef04eb1933495f112230dce', 'request_id': 'req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.351923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:59.352842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.352993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.353272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.353965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:09:59.354267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:59.357427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:59.363691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] The token cache is being invalidate because project fff8882aeef04eb1933495f112230dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:09:59.364091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.364857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.366841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1048/2074] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:09:58 2022] DELETE /identity/v3/projects/fff8882aeef04eb1933495f112230dce => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:09:59.372223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1027/2075] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:09:59.373338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:59.373727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:59.374822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:59.375447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:59.390018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8795c4-ccc4-4aa9-ba42-72b229f81e37 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:59.390241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278020b3-d0dc-4836-8c05-64588e5a5551 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:59.396249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:59.397010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.397354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.397715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] PATH_INFO: `/v3/users/36fbbed4433e42f1b65780b61019d383` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.398975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fbbed4433e42f1b65780b61019d383)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:59.399092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda694c-2b1d-4833-acff-0ba1c2b9ee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:59.399859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda694c-2b1d-4833-acff-0ba1c2b9ee0e admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.400280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda694c-2b1d-4833-acff-0ba1c2b9ee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.400841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda694c-2b1d-4833-acff-0ba1c2b9ee0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.401755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:59.401924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda694c-2b1d-4833-acff-0ba1c2b9ee0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:59.403972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda694c-2b1d-4833-acff-0ba1c2b9ee0e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:59.563958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1028/2076] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:09:59 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:59.568240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda694c-2b1d-4833-acff-0ba1c2b9ee0e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:59.630031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda694c-2b1d-4833-acff-0ba1c2b9ee0e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:59.634591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0feaa3a-37aa-41b0-904d-589d43202148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:59.635594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feaa3a-37aa-41b0-904d-589d43202148 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.635874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feaa3a-37aa-41b0-904d-589d43202148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.636146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feaa3a-37aa-41b0-904d-589d43202148 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.636908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0feaa3a-37aa-41b0-904d-589d43202148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:59.639481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0feaa3a-37aa-41b0-904d-589d43202148 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:59.719307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fbbed4433e42f1b65780b61019d383'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.720096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fbbed4433e42f1b65780b61019d383'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.728260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fbbed4433e42f1b65780b61019d383'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.729101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fbbed4433e42f1b65780b61019d383'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.744257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fbbed4433e42f1b65780b61019d383'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:09:59.778583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1029/2077] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:09:59 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:09:59.782676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0feaa3a-37aa-41b0-904d-589d43202148 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:59.786141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f0feaa3a-37aa-41b0-904d-589d43202148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:09:59.802968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0feaa3a-37aa-41b0-904d-589d43202148 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:59.808465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41748a95-4896-4561-bedb-33a7ffb2ef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:59.809137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41748a95-4896-4561-bedb-33a7ffb2ef72 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.809421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41748a95-4896-4561-bedb-33a7ffb2ef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.809696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41748a95-4896-4561-bedb-33a7ffb2ef72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.810407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41748a95-4896-4561-bedb-33a7ffb2ef72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:59.813322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41748a95-4896-4561-bedb-33a7ffb2ef72 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:59.825654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1030/2078] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:59.829763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41748a95-4896-4561-bedb-33a7ffb2ef72 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:59.841350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41748a95-4896-4561-bedb-33a7ffb2ef72 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:59.846677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc99e7-7362-427c-9160-7af3c6e6c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:59.847533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc99e7-7362-427c-9160-7af3c6e6c2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.848120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc99e7-7362-427c-9160-7af3c6e6c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.848625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc99e7-7362-427c-9160-7af3c6e6c2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.849526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc99e7-7362-427c-9160-7af3c6e6c2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:59.851291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc99e7-7362-427c-9160-7af3c6e6c2a9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:09:59.856149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1049/2079] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:09:59 2022] DELETE /identity/v3/users/36fbbed4433e42f1b65780b61019d383 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:09:59.862399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1031/2080] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:09:59.867362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:09:59.939885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87275137-930b-4321-80f7-3c4a1c92b871 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:09:59.944862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc11bd-5466-4940-8b60-1ef868d8c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:09:59.945709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc11bd-5466-4940-8b60-1ef868d8c910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:09:59.945988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc11bd-5466-4940-8b60-1ef868d8c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:09:59.946262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc11bd-5466-4940-8b60-1ef868d8c910 admin admin] PATH_INFO: `/v3/projects/b2f1bfe91abd4aef97cea34ab8190198/users/a1a734db2ac94f2ca0ef12bf74d5458f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:09:59.961441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc11bd-5466-4940-8b60-1ef868d8c910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f1bfe91abd4aef97cea34ab8190198, user_id=a1a734db2ac94f2ca0ef12bf74d5458f, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:09:59.964343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc11bd-5466-4940-8b60-1ef868d8c910 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:00.113154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1050/2081] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:09:59 2022] PUT /identity/v3/projects/b2f1bfe91abd4aef97cea34ab8190198/users/a1a734db2ac94f2ca0ef12bf74d5458f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:00.124946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797be8b-5b2e-452c-b098-584f28c558da None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:00.125474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797be8b-5b2e-452c-b098-584f28c558da None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:00.125903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797be8b-5b2e-452c-b098-584f28c558da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:00.201354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a797be8b-5b2e-452c-b098-584f28c558da None None] MFA Rules not processed for user `a1a734db2ac94f2ca0ef12bf74d5458f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:00.202724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a797be8b-5b2e-452c-b098-584f28c558da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:00.347984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1032/2082] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:00.352514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc11bd-5466-4940-8b60-1ef868d8c910 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:00.467889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc11bd-5466-4940-8b60-1ef868d8c910 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:00.491894 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205faeca-7ab9-4853-afa5-a8e38afe95d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:00.492532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205faeca-7ab9-4853-afa5-a8e38afe95d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:00.492854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205faeca-7ab9-4853-afa5-a8e38afe95d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:00.493109 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205faeca-7ab9-4853-afa5-a8e38afe95d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:00.493785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205faeca-7ab9-4853-afa5-a8e38afe95d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:00.495726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205faeca-7ab9-4853-afa5-a8e38afe95d9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:00.668065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1051/2083] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:10:00 2022] POST /identity/v3/projects => generated 377 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:10:00.669922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205faeca-7ab9-4853-afa5-a8e38afe95d9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:00.670213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797be8b-5b2e-452c-b098-584f28c558da None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:00.671955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a797be8b-5b2e-452c-b098-584f28c558da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:00.688074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797be8b-5b2e-452c-b098-584f28c558da None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:00.710943 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:00.765331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:00.766638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:00.767274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:00.767692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] PATH_INFO: `/v3/projects/f9e3eeb64c1c4dc3b9526394e9d8107b` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:00.769439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e3eeb64c1c4dc3b9526394e9d8107b)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:00.772998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:00.773967 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205faeca-7ab9-4853-afa5-a8e38afe95d9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:00.788910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d9eb8-3f71-49d6-94e1-321ba4a076a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:00.788910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d9eb8-3f71-49d6-94e1-321ba4a076a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:00.788910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d9eb8-3f71-49d6-94e1-321ba4a076a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:00.788910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d9eb8-3f71-49d6-94e1-321ba4a076a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:00.789410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d9eb8-3f71-49d6-94e1-321ba4a076a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:00.789410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d9eb8-3f71-49d6-94e1-321ba4a076a5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:00.901185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1052/2084] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:10:00 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:00.901654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d9eb8-3f71-49d6-94e1-321ba4a076a5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:00.912039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d9eb8-3f71-49d6-94e1-321ba4a076a5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:00.916964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061c61-4a1e-4e20-8c44-f3cea0726316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:00.917650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061c61-4a1e-4e20-8c44-f3cea0726316 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:00.917927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061c61-4a1e-4e20-8c44-f3cea0726316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:00.918196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061c61-4a1e-4e20-8c44-f3cea0726316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:00.919030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80061c61-4a1e-4e20-8c44-f3cea0726316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:00.920650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80061c61-4a1e-4e20-8c44-f3cea0726316 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:00.931572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1053/2085] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:00.938706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061c61-4a1e-4e20-8c44-f3cea0726316 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:00.947709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e3eeb64c1c4dc3b9526394e9d8107b', 'request_id': 'req-a76e7157-4852-4def-84cf-201c275a5843'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:00.953510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061c61-4a1e-4e20-8c44-f3cea0726316 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:00.954570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e3eeb64c1c4dc3b9526394e9d8107b', 'request_id': 'req-a76e7157-4852-4def-84cf-201c275a5843'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:01.016828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ffece-bd53-43be-b7cb-eada6fc45fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.017477 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ffece-bd53-43be-b7cb-eada6fc45fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.017885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ffece-bd53-43be-b7cb-eada6fc45fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.018301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ffece-bd53-43be-b7cb-eada6fc45fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.018857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ffece-bd53-43be-b7cb-eada6fc45fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.020485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ffece-bd53-43be-b7cb-eada6fc45fbd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.030396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1054/2086] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:10:01.034437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ffece-bd53-43be-b7cb-eada6fc45fbd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.044586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ffece-bd53-43be-b7cb-eada6fc45fbd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.046498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e3eeb64c1c4dc3b9526394e9d8107b', 'request_id': 'req-a76e7157-4852-4def-84cf-201c275a5843'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:01.050279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf94c2-8d85-426f-9ef5-7fcc7ef20773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.050938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf94c2-8d85-426f-9ef5-7fcc7ef20773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.051364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf94c2-8d85-426f-9ef5-7fcc7ef20773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.051681 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf94c2-8d85-426f-9ef5-7fcc7ef20773 admin admin] PATH_INFO: `/v3/projects/83c29a1164f54ad7bd76a810cc4b7abd/users/fe6ac0ff6fc54dec8d7ddbbfda64d583/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.060963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] The token cache is being invalidate because project f9e3eeb64c1c4dc3b9526394e9d8107b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:01.061585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:01.062335 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a76e7157-4852-4def-84cf-201c275a5843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:01.064072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1033/2087] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:00 2022] DELETE /identity/v3/projects/f9e3eeb64c1c4dc3b9526394e9d8107b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:01.069209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e049d-7374-407b-8047-17ba9d70d26d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.069576 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e049d-7374-407b-8047-17ba9d70d26d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.069927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e049d-7374-407b-8047-17ba9d70d26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.071540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf94c2-8d85-426f-9ef5-7fcc7ef20773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c29a1164f54ad7bd76a810cc4b7abd, user_id=fe6ac0ff6fc54dec8d7ddbbfda64d583, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.074511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf94c2-8d85-426f-9ef5-7fcc7ef20773 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.094705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-384e049d-7374-407b-8047-17ba9d70d26d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:01.096637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-384e049d-7374-407b-8047-17ba9d70d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:01.106641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1034/2088] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:01.114777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb3cf-8c86-422f-abda-bcc27901b30f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.115056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb3cf-8c86-422f-abda-bcc27901b30f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.115323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb3cf-8c86-422f-abda-bcc27901b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.134055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-fedfb3cf-8c86-422f-abda-bcc27901b30f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:01.135253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fedfb3cf-8c86-422f-abda-bcc27901b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:01.142940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1035/2089] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:01.146929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb3cf-8c86-422f-abda-bcc27901b30f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.155985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb3cf-8c86-422f-abda-bcc27901b30f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.165840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1055/2090] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:01 2022] PUT /identity/v3/projects/83c29a1164f54ad7bd76a810cc4b7abd/users/fe6ac0ff6fc54dec8d7ddbbfda64d583/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:01.175065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7f6b-5633-4880-9118-4215362cde9f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.175356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7f6b-5633-4880-9118-4215362cde9f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.175632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7f6b-5633-4880-9118-4215362cde9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.204564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a0ce7f6b-5633-4880-9118-4215362cde9f None None] MFA Rules not processed for user `fe6ac0ff6fc54dec8d7ddbbfda64d583`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:01.205828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a0ce7f6b-5633-4880-9118-4215362cde9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:01.214291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e30b1-7a3e-4d81-ba89-03e349cca04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.214901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e30b1-7a3e-4d81-ba89-03e349cca04a admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.215223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e30b1-7a3e-4d81-ba89-03e349cca04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.215493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e30b1-7a3e-4d81-ba89-03e349cca04a admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.216181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e30b1-7a3e-4d81-ba89-03e349cca04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:10:01.216534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e30b1-7a3e-4d81-ba89-03e349cca04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.218145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e30b1-7a3e-4d81-ba89-03e349cca04a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.230168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1036/2091] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:10:01.234383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e30b1-7a3e-4d81-ba89-03e349cca04a admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.244217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e30b1-7a3e-4d81-ba89-03e349cca04a admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.248919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab5e9-0a33-4d29-8d64-bce66a92b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.249531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab5e9-0a33-4d29-8d64-bce66a92b57d admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.249812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab5e9-0a33-4d29-8d64-bce66a92b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.250317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab5e9-0a33-4d29-8d64-bce66a92b57d admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.250723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ab5e9-0a33-4d29-8d64-bce66a92b57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.252609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ab5e9-0a33-4d29-8d64-bce66a92b57d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.271839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1056/2092] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:01.276355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7f6b-5633-4880-9118-4215362cde9f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.277726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a0ce7f6b-5633-4880-9118-4215362cde9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:01.292696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7f6b-5633-4880-9118-4215362cde9f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.297493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cca33-7cc3-4bd8-9358-782666b97f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.298090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cca33-7cc3-4bd8-9358-782666b97f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.298365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cca33-7cc3-4bd8-9358-782666b97f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.298636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cca33-7cc3-4bd8-9358-782666b97f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.299291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cca33-7cc3-4bd8-9358-782666b97f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.301206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cca33-7cc3-4bd8-9358-782666b97f8f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.381557 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1037/2093] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:10:01 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:01.385814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab5e9-0a33-4d29-8d64-bce66a92b57d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.411202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1057/2094] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:10:01 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:01.420315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cca33-7cc3-4bd8-9358-782666b97f8f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.447700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab5e9-0a33-4d29-8d64-bce66a92b57d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.481734 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cca33-7cc3-4bd8-9358-782666b97f8f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.486548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60de3b2-12d0-45ca-89ea-cb0a359a935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.487206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60de3b2-12d0-45ca-89ea-cb0a359a935f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.487556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60de3b2-12d0-45ca-89ea-cb0a359a935f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.487841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60de3b2-12d0-45ca-89ea-cb0a359a935f admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.488518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60de3b2-12d0-45ca-89ea-cb0a359a935f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.491156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60de3b2-12d0-45ca-89ea-cb0a359a935f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.506810 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d30b08-13f1-4121-b2c1-1b2449bbfd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.508878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d30b08-13f1-4121-b2c1-1b2449bbfd22 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.508878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d30b08-13f1-4121-b2c1-1b2449bbfd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.508878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d30b08-13f1-4121-b2c1-1b2449bbfd22 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.508878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d30b08-13f1-4121-b2c1-1b2449bbfd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.510677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d30b08-13f1-4121-b2c1-1b2449bbfd22 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.591603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1058/2095] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:10:01 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:01.595447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60de3b2-12d0-45ca-89ea-cb0a359a935f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.601321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:01.607091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60de3b2-12d0-45ca-89ea-cb0a359a935f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.611673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1038/2096] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:10:01 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:01.617688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5683a-ac5b-4b9a-8273-f89676598ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.617900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d30b08-13f1-4121-b2c1-1b2449bbfd22 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.618348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5683a-ac5b-4b9a-8273-f89676598ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.618860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5683a-ac5b-4b9a-8273-f89676598ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.619240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5683a-ac5b-4b9a-8273-f89676598ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.619961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5683a-ac5b-4b9a-8273-f89676598ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.621714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5683a-ac5b-4b9a-8273-f89676598ddf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.629426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d30b08-13f1-4121-b2c1-1b2449bbfd22 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.632493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1059/2097] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:10:01.635096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90863f0-fc07-498f-b7ef-690b7acb2e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.635768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90863f0-fc07-498f-b7ef-690b7acb2e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.640905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90863f0-fc07-498f-b7ef-690b7acb2e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.640905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90863f0-fc07-498f-b7ef-690b7acb2e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.640905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90863f0-fc07-498f-b7ef-690b7acb2e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.640905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90863f0-fc07-498f-b7ef-690b7acb2e42 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.642480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5683a-ac5b-4b9a-8273-f89676598ddf admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.651499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1039/2098] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:01.653238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5683a-ac5b-4b9a-8273-f89676598ddf admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.655991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90863f0-fc07-498f-b7ef-690b7acb2e42 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.658505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae3c89-ddcd-4d43-9af7-81aa4cc6a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.659675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae3c89-ddcd-4d43-9af7-81aa4cc6a95b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.659675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae3c89-ddcd-4d43-9af7-81aa4cc6a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.659889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae3c89-ddcd-4d43-9af7-81aa4cc6a95b admin admin] PATH_INFO: `/v3/projects/5f3b7ffb52964194b3d0e0a33a28f398/users/245198a659744a7cb3bb44a71ced19e3/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.667247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90863f0-fc07-498f-b7ef-690b7acb2e42 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.675307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e1429-eb5f-413a-b3d7-ffa5f49846f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.675307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e1429-eb5f-413a-b3d7-ffa5f49846f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.675307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e1429-eb5f-413a-b3d7-ffa5f49846f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.675307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e1429-eb5f-413a-b3d7-ffa5f49846f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.675865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e1429-eb5f-413a-b3d7-ffa5f49846f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.676839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae3c89-ddcd-4d43-9af7-81aa4cc6a95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3b7ffb52964194b3d0e0a33a28f398, user_id=245198a659744a7cb3bb44a71ced19e3, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.677684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e1429-eb5f-413a-b3d7-ffa5f49846f7 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.679641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae3c89-ddcd-4d43-9af7-81aa4cc6a95b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.694729 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1040/2099] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:01.698959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e1429-eb5f-413a-b3d7-ffa5f49846f7 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.709552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e1429-eb5f-413a-b3d7-ffa5f49846f7 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.714556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb7d2d-772e-4893-9022-4217dc5b0c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.715209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7d2d-772e-4893-9022-4217dc5b0c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.715497 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7d2d-772e-4893-9022-4217dc5b0c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.715775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb7d2d-772e-4893-9022-4217dc5b0c50 admin admin] PATH_INFO: `/v3/projects/3e10f41695444bac87afac731ce9954d/users/4721140f65dc41009259b8d50b9e7cfd/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.732092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb7d2d-772e-4893-9022-4217dc5b0c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e10f41695444bac87afac731ce9954d, user_id=4721140f65dc41009259b8d50b9e7cfd, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.735302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb7d2d-772e-4893-9022-4217dc5b0c50 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.798547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1060/2100] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:01 2022] PUT /identity/v3/projects/5f3b7ffb52964194b3d0e0a33a28f398/users/245198a659744a7cb3bb44a71ced19e3/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:01.814989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae3c89-ddcd-4d43-9af7-81aa4cc6a95b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.877301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae3c89-ddcd-4d43-9af7-81aa4cc6a95b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.882186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4747b-993a-450c-86cd-2807c22c4c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.882793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4747b-993a-450c-86cd-2807c22c4c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.883076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4747b-993a-450c-86cd-2807c22c4c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.883351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4747b-993a-450c-86cd-2807c22c4c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.884047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4747b-993a-450c-86cd-2807c22c4c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.885661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4747b-993a-450c-86cd-2807c22c4c6e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.895506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1061/2101] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:10:01.899595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4747b-993a-450c-86cd-2807c22c4c6e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:01.909033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4747b-993a-450c-86cd-2807c22c4c6e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:01.914450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f957653-72f0-46d2-9abc-7d52fc9aa8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:01.915073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f957653-72f0-46d2-9abc-7d52fc9aa8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.915353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f957653-72f0-46d2-9abc-7d52fc9aa8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.915657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f957653-72f0-46d2-9abc-7d52fc9aa8cb admin admin] PATH_INFO: `/v3/projects/5f3b7ffb52964194b3d0e0a33a28f398/users/245198a659744a7cb3bb44a71ced19e3/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.917610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f957653-72f0-46d2-9abc-7d52fc9aa8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3b7ffb52964194b3d0e0a33a28f398, user_id=245198a659744a7cb3bb44a71ced19e3, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:01.920254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f957653-72f0-46d2-9abc-7d52fc9aa8cb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:01.930957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1062/2102] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:01 2022] PUT /identity/v3/projects/5f3b7ffb52964194b3d0e0a33a28f398/users/245198a659744a7cb3bb44a71ced19e3/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:01.940710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ce3fe-e42a-4c58-bbea-d759bb8245c8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.941029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ce3fe-e42a-4c58-bbea-d759bb8245c8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.941306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ce3fe-e42a-4c58-bbea-d759bb8245c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.954694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1041/2103] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:01 2022] PUT /identity/v3/projects/3e10f41695444bac87afac731ce9954d/users/4721140f65dc41009259b8d50b9e7cfd/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:01.966404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c4d8-4fc3-496d-a85a-992667950391 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:01.966992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c4d8-4fc3-496d-a85a-992667950391 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:01.967597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c4d8-4fc3-496d-a85a-992667950391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:01.969831 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6c3ce3fe-e42a-4c58-bbea-d759bb8245c8 None None] MFA Rules not processed for user `245198a659744a7cb3bb44a71ced19e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:01.971166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6c3ce3fe-e42a-4c58-bbea-d759bb8245c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:02.004667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a974c4d8-4fc3-496d-a85a-992667950391 None None] MFA Rules not processed for user `4721140f65dc41009259b8d50b9e7cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:02.006752 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a974c4d8-4fc3-496d-a85a-992667950391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:02.047467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1063/2104] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:02.073204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1042/2105] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:02.077791 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ce3fe-e42a-4c58-bbea-d759bb8245c8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:02.139306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ce3fe-e42a-4c58-bbea-d759bb8245c8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:02.144006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aa3ba-e135-43ea-b538-a1f317f4fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:02.144628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa3ba-e135-43ea-b538-a1f317f4fe9b admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:02.144940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa3ba-e135-43ea-b538-a1f317f4fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:02.145749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa3ba-e135-43ea-b538-a1f317f4fe9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:02.146430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aa3ba-e135-43ea-b538-a1f317f4fe9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:02.148337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912aa3ba-e135-43ea-b538-a1f317f4fe9b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:02.223479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974c4d8-4fc3-496d-a85a-992667950391 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:02.225928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a974c4d8-4fc3-496d-a85a-992667950391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:02.251572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1064/2106] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:10:02 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:02.257780 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aa3ba-e135-43ea-b538-a1f317f4fe9b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:02.290387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974c4d8-4fc3-496d-a85a-992667950391 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:02.322579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912aa3ba-e135-43ea-b538-a1f317f4fe9b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:02.327779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b37ccb-fd55-4e51-b8ab-9c56d0a1b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:02.328465 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b37ccb-fd55-4e51-b8ab-9c56d0a1b0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:02.328752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b37ccb-fd55-4e51-b8ab-9c56d0a1b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:02.329058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b37ccb-fd55-4e51-b8ab-9c56d0a1b0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:02.329724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b37ccb-fd55-4e51-b8ab-9c56d0a1b0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:02.331649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b37ccb-fd55-4e51-b8ab-9c56d0a1b0a2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:02.340254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c5e44-1662-4a43-b81c-1631ff62b4a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:02.340945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c5e44-1662-4a43-b81c-1631ff62b4a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:02.341181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c5e44-1662-4a43-b81c-1631ff62b4a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:02.341453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c5e44-1662-4a43-b81c-1631ff62b4a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:02.403251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c5e44-1662-4a43-b81c-1631ff62b4a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:02.404702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c5e44-1662-4a43-b81c-1631ff62b4a7 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:02.415005 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1043/2107] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:02.461294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1065/2108] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:10:02 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:10:02.465678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c5e44-1662-4a43-b81c-1631ff62b4a7 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:02.476710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c5e44-1662-4a43-b81c-1631ff62b4a7 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:02.481541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4206b6c-4981-4c82-adfc-6b07ebffc0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:02.482143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206b6c-4981-4c82-adfc-6b07ebffc0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:02.486995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206b6c-4981-4c82-adfc-6b07ebffc0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:02.486995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206b6c-4981-4c82-adfc-6b07ebffc0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:02.486995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4206b6c-4981-4c82-adfc-6b07ebffc0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:02.486995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4206b6c-4981-4c82-adfc-6b07ebffc0b0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:02.495732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1044/2109] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:10:02.500110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b37ccb-fd55-4e51-b8ab-9c56d0a1b0a2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:02.510816 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b37ccb-fd55-4e51-b8ab-9c56d0a1b0a2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:02.517768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb304da-9a08-40a8-a97f-7999a1e0c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:02.517768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb304da-9a08-40a8-a97f-7999a1e0c903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:02.517768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb304da-9a08-40a8-a97f-7999a1e0c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:02.517768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb304da-9a08-40a8-a97f-7999a1e0c903 admin admin] PATH_INFO: `/v3/projects/7180ef0dbe2941798405392fdc6bfe7f/users/c172f3b1c9a34686a94199bd9e787ab3/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:02.532635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb304da-9a08-40a8-a97f-7999a1e0c903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7180ef0dbe2941798405392fdc6bfe7f, user_id=c172f3b1c9a34686a94199bd9e787ab3, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:02.535425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb304da-9a08-40a8-a97f-7999a1e0c903 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:02.589673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4206b6c-4981-4c82-adfc-6b07ebffc0b0 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:02.599407 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4206b6c-4981-4c82-adfc-6b07ebffc0b0 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:02.603041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54d23-23d3-4448-ae3a-7f74d508ad88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:02.603642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54d23-23d3-4448-ae3a-7f74d508ad88 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:02.603918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54d23-23d3-4448-ae3a-7f74d508ad88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:02.604188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb54d23-23d3-4448-ae3a-7f74d508ad88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:02.605965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-eeb54d23-23d3-4448-ae3a-7f74d508ad88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:02.664254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb54d23-23d3-4448-ae3a-7f74d508ad88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:02.665710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb54d23-23d3-4448-ae3a-7f74d508ad88 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:02.674362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1045/2110] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:02.769952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1066/2111] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:02 2022] PUT /identity/v3/projects/7180ef0dbe2941798405392fdc6bfe7f/users/c172f3b1c9a34686a94199bd9e787ab3/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:02.778449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54d23-23d3-4448-ae3a-7f74d508ad88 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:02.791887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb54d23-23d3-4448-ae3a-7f74d508ad88 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:02.870042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862b8d-e0f2-4794-be4a-88cebf3d9c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:02.870754 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862b8d-e0f2-4794-be4a-88cebf3d9c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:02.871098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862b8d-e0f2-4794-be4a-88cebf3d9c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:02.871381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862b8d-e0f2-4794-be4a-88cebf3d9c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:02.872263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16862b8d-e0f2-4794-be4a-88cebf3d9c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:02.873936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16862b8d-e0f2-4794-be4a-88cebf3d9c77 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:02.888581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1046/2112] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:02.889857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb304da-9a08-40a8-a97f-7999a1e0c903 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:02.901817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb304da-9a08-40a8-a97f-7999a1e0c903 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:02.919933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e517-b73e-49fb-8e6a-d7d6717dab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:02.920612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e517-b73e-49fb-8e6a-d7d6717dab87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:02.920925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e517-b73e-49fb-8e6a-d7d6717dab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:02.921205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e517-b73e-49fb-8e6a-d7d6717dab87 admin admin] PATH_INFO: `/v3/projects/7180ef0dbe2941798405392fdc6bfe7f/users/c172f3b1c9a34686a94199bd9e787ab3/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:02.923173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49e517-b73e-49fb-8e6a-d7d6717dab87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7180ef0dbe2941798405392fdc6bfe7f, user_id=c172f3b1c9a34686a94199bd9e787ab3, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:02.925895 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49e517-b73e-49fb-8e6a-d7d6717dab87 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:02.937327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1067/2113] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:02 2022] PUT /identity/v3/projects/7180ef0dbe2941798405392fdc6bfe7f/users/c172f3b1c9a34686a94199bd9e787ab3/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:02.948514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5392673-648d-4751-92e8-ad92b9b8bdd0 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:02.950007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5392673-648d-4751-92e8-ad92b9b8bdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:02.950007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5392673-648d-4751-92e8-ad92b9b8bdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:02.977715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-d5392673-648d-4751-92e8-ad92b9b8bdd0 None None] MFA Rules not processed for user `c172f3b1c9a34686a94199bd9e787ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:02.978846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d5392673-648d-4751-92e8-ad92b9b8bdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:03.044930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1047/2114] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:03.249592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e517-b73e-49fb-8e6a-d7d6717dab87 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:03.303118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e517-b73e-49fb-8e6a-d7d6717dab87 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:03.306731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d97ab-0319-485f-af4b-4214a15fc260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:03.307340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d97ab-0319-485f-af4b-4214a15fc260 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:03.307622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d97ab-0319-485f-af4b-4214a15fc260 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:03.307896 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d97ab-0319-485f-af4b-4214a15fc260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:03.317035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d97ab-0319-485f-af4b-4214a15fc260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:03.318450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d97ab-0319-485f-af4b-4214a15fc260 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:03.327721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1068/2115] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:03.495033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5392673-648d-4751-92e8-ad92b9b8bdd0 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:03.501426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5392673-648d-4751-92e8-ad92b9b8bdd0 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:03.505148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b96e5e-bc11-4cf9-9902-644cf09fa073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:03.505760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96e5e-bc11-4cf9-9902-644cf09fa073 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:03.506124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96e5e-bc11-4cf9-9902-644cf09fa073 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:03.506414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b96e5e-bc11-4cf9-9902-644cf09fa073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:03.563850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b96e5e-bc11-4cf9-9902-644cf09fa073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:03.565332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b96e5e-bc11-4cf9-9902-644cf09fa073 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:03.574250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1048/2116] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:04.240839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:05.247896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:08.586221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d97ab-0319-485f-af4b-4214a15fc260 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:08.660701 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0ea27-3917-4545-b795-e799f9913a75 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:08.661244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0ea27-3917-4545-b795-e799f9913a75 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:08.661377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0ea27-3917-4545-b795-e799f9913a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:08.665030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d97ab-0319-485f-af4b-4214a15fc260 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:08.670684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:08.671433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:08.671826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:08.672166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] PATH_INFO: `/v3/users/4721140f65dc41009259b8d50b9e7cfd` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:08.673479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4721140f65dc41009259b8d50b9e7cfd)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:08.675668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:08.681621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c7e0ea27-3917-4545-b795-e799f9913a75 None None] MFA Rules not processed for user `eb2b7be73e534e09a80c69d2f08f0cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:08.682827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c7e0ea27-3917-4545-b795-e799f9913a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:08.746159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1049/2117] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:08.980353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4721140f65dc41009259b8d50b9e7cfd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:08.981273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4721140f65dc41009259b8d50b9e7cfd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:09.003630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4721140f65dc41009259b8d50b9e7cfd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:09.004455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4721140f65dc41009259b8d50b9e7cfd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:09.022030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4721140f65dc41009259b8d50b9e7cfd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:09.243290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1069/2118] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:10:08 2022] DELETE /identity/v3/users/4721140f65dc41009259b8d50b9e7cfd => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:09.248872 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20fca-34de-4015-bab7-9bc220d792dd None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:09.249240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20fca-34de-4015-bab7-9bc220d792dd None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:09.249693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20fca-34de-4015-bab7-9bc220d792dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:09.272240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-26a20fca-34de-4015-bab7-9bc220d792dd None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:09.273725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-26a20fca-34de-4015-bab7-9bc220d792dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:09.339120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1050/2119] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:09.350810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:09.352312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:09.415720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feebeb-1957-465e-afb7-78fef5dc733d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:09.419321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f473d-9f8f-41ed-b0aa-d0d6d72c5a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:09.419931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f473d-9f8f-41ed-b0aa-d0d6d72c5a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:09.420207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f473d-9f8f-41ed-b0aa-d0d6d72c5a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:09.420475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f473d-9f8f-41ed-b0aa-d0d6d72c5a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:09.429918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f473d-9f8f-41ed-b0aa-d0d6d72c5a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:09.431321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f473d-9f8f-41ed-b0aa-d0d6d72c5a60 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:09.440572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1070/2120] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:10:09.837352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:09.988454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a20fca-34de-4015-bab7-9bc220d792dd None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:09.988454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-26a20fca-34de-4015-bab7-9bc220d792dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:10.001336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a20fca-34de-4015-bab7-9bc220d792dd None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:10.006957 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:10.007885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:10.008364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:10.008822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] PATH_INFO: `/v3/projects/3e10f41695444bac87afac731ce9954d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:10.018782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e10f41695444bac87afac731ce9954d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:10.018782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:10.039142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f473d-9f8f-41ed-b0aa-d0d6d72c5a60 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:10.040569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2a8f473d-9f8f-41ed-b0aa-d0d6d72c5a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:10.053447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f473d-9f8f-41ed-b0aa-d0d6d72c5a60 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:10.058180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:10.058897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:10.059241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:10.059581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] PATH_INFO: `/v3/users/a1a734db2ac94f2ca0ef12bf74d5458f` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:10.060935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a734db2ac94f2ca0ef12bf74d5458f)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:10.062898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:10.193919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e10f41695444bac87afac731ce9954d', 'request_id': 'req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.200093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e10f41695444bac87afac731ce9954d', 'request_id': 'req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.315930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e10f41695444bac87afac731ce9954d', 'request_id': 'req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.329481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] The token cache is being invalidate because project 3e10f41695444bac87afac731ce9954d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:10.330232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.330478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.335869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1051/2121] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:09 2022] DELETE /identity/v3/projects/3e10f41695444bac87afac731ce9954d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:10.337721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:10.338956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:10.365492 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a734db2ac94f2ca0ef12bf74d5458f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.366487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a734db2ac94f2ca0ef12bf74d5458f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.374861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a734db2ac94f2ca0ef12bf74d5458f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.375624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a734db2ac94f2ca0ef12bf74d5458f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.388330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8e87bfb3-6372-459c-b6a8-c467b1dd1a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a734db2ac94f2ca0ef12bf74d5458f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.408274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da7bdf-7ef2-4538-b3e4-9eced4720b0d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:10.413636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:10.414275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:10.414558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:10.414833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] PATH_INFO: `/v3/users/c172f3b1c9a34686a94199bd9e787ab3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:10.416015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c172f3b1c9a34686a94199bd9e787ab3)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:10.418035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:10.523834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1071/2122] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:10:10 2022] DELETE /identity/v3/users/a1a734db2ac94f2ca0ef12bf74d5458f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:10.528249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a736-4886-4596-9ac6-e74b1f45fc6c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:10.528430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a736-4886-4596-9ac6-e74b1f45fc6c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:10.528711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a736-4886-4596-9ac6-e74b1f45fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:10.550543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e7f8a736-4886-4596-9ac6-e74b1f45fc6c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:10.551756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e7f8a736-4886-4596-9ac6-e74b1f45fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:10.616741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1072/2123] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:10.628952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a736-4886-4596-9ac6-e74b1f45fc6c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:10.630306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e7f8a736-4886-4596-9ac6-e74b1f45fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:10.686318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a736-4886-4596-9ac6-e74b1f45fc6c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:10.689986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af835b04-2913-43f6-8f13-53bbcadc9d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:10.690720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af835b04-2913-43f6-8f13-53bbcadc9d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:10.691007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af835b04-2913-43f6-8f13-53bbcadc9d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:10.691282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af835b04-2913-43f6-8f13-53bbcadc9d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:10.700816 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af835b04-2913-43f6-8f13-53bbcadc9d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:10.702243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af835b04-2913-43f6-8f13-53bbcadc9d63 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:10.712542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1073/2124] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:10:10.782848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c172f3b1c9a34686a94199bd9e787ab3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.783631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c172f3b1c9a34686a94199bd9e787ab3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.921779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c172f3b1c9a34686a94199bd9e787ab3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.922535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c172f3b1c9a34686a94199bd9e787ab3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.936954 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c172f3b1c9a34686a94199bd9e787ab3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:10.952552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1052/2125] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:10:10 2022] DELETE /identity/v3/users/c172f3b1c9a34686a94199bd9e787ab3 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:11.333167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af835b04-2913-43f6-8f13-53bbcadc9d63 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:11.337489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-af835b04-2913-43f6-8f13-53bbcadc9d63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:11.350962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af835b04-2913-43f6-8f13-53bbcadc9d63 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:11.428596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:11.429293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:11.429622 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:11.429903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] PATH_INFO: `/v3/projects/b2f1bfe91abd4aef97cea34ab8190198` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:11.431930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f1bfe91abd4aef97cea34ab8190198)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:11.437511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:12.056483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:12.059310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:12.073374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f1bfe91abd4aef97cea34ab8190198', 'request_id': 'req-8b51cfdc-564d-496d-afdc-0c57256e11a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.080989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66519c63-f4fd-4328-9836-49dde5275899 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:12.154475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:12.155035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:12.155441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:12.155722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] PATH_INFO: `/v3/projects/7180ef0dbe2941798405392fdc6bfe7f` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:12.157099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7180ef0dbe2941798405392fdc6bfe7f)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:12.159067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:12.179574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f1bfe91abd4aef97cea34ab8190198', 'request_id': 'req-8b51cfdc-564d-496d-afdc-0c57256e11a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.183833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:12.186500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f1bfe91abd4aef97cea34ab8190198', 'request_id': 'req-8b51cfdc-564d-496d-afdc-0c57256e11a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.198545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] The token cache is being invalidate because project b2f1bfe91abd4aef97cea34ab8190198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:12.198876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.199542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.201163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1074/2126] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:11 2022] DELETE /identity/v3/projects/b2f1bfe91abd4aef97cea34ab8190198 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:12.204976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:12.206233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:12.219048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51cfdc-564d-496d-afdc-0c57256e11a4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:12.223574 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:12.224184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:12.224467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:12.224741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] PATH_INFO: `/v3/users/fe6ac0ff6fc54dec8d7ddbbfda64d583` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:12.225945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe6ac0ff6fc54dec8d7ddbbfda64d583)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:12.227871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:12.291478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7180ef0dbe2941798405392fdc6bfe7f', 'request_id': 'req-a66a90d5-8e8a-478b-9488-4320e98ebe78'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.297577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7180ef0dbe2941798405392fdc6bfe7f', 'request_id': 'req-a66a90d5-8e8a-478b-9488-4320e98ebe78'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.397653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7180ef0dbe2941798405392fdc6bfe7f', 'request_id': 'req-a66a90d5-8e8a-478b-9488-4320e98ebe78'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.411240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] The token cache is being invalidate because project 7180ef0dbe2941798405392fdc6bfe7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:12.411655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.412417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a66a90d5-8e8a-478b-9488-4320e98ebe78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.414020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1053/2127] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:12 2022] DELETE /identity/v3/projects/7180ef0dbe2941798405392fdc6bfe7f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:12.418680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7de7da-bfa2-48e0-ade9-535ed9570bb0 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:12.419067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7de7da-bfa2-48e0-ade9-535ed9570bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:12.419424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7de7da-bfa2-48e0-ade9-535ed9570bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:12.440144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-4c7de7da-bfa2-48e0-ade9-535ed9570bb0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:12.441503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4c7de7da-bfa2-48e0-ade9-535ed9570bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:12.509684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1054/2128] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:12.517493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c00cf-4afe-45c2-a8f4-bbec59106fed None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:12.517782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c00cf-4afe-45c2-a8f4-bbec59106fed None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:12.518060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c00cf-4afe-45c2-a8f4-bbec59106fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:12.539505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ff8c00cf-4afe-45c2-a8f4-bbec59106fed None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:12.540722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ff8c00cf-4afe-45c2-a8f4-bbec59106fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:12.551973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1055/2129] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:12.554533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c00cf-4afe-45c2-a8f4-bbec59106fed None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:12.562480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c00cf-4afe-45c2-a8f4-bbec59106fed None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:12.567514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28de7-ddea-4f1d-97cb-a67641878ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:12.568103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28de7-ddea-4f1d-97cb-a67641878ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:12.568383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28de7-ddea-4f1d-97cb-a67641878ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:12.568684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28de7-ddea-4f1d-97cb-a67641878ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:12.569409 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c28de7-ddea-4f1d-97cb-a67641878ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:10:12.569713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c28de7-ddea-4f1d-97cb-a67641878ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:12.571333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c28de7-ddea-4f1d-97cb-a67641878ea8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:12.583489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1056/2130] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:10:12.590678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28de7-ddea-4f1d-97cb-a67641878ea8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:12.600713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28de7-ddea-4f1d-97cb-a67641878ea8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:12.605315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f354b0-3bac-4301-bb40-4143879c68ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:12.606527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f354b0-3bac-4301-bb40-4143879c68ae admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:12.606808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f354b0-3bac-4301-bb40-4143879c68ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:12.607080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f354b0-3bac-4301-bb40-4143879c68ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:12.607729 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f354b0-3bac-4301-bb40-4143879c68ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:12.609651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f354b0-3bac-4301-bb40-4143879c68ae admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:12.627865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe6ac0ff6fc54dec8d7ddbbfda64d583'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.628544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe6ac0ff6fc54dec8d7ddbbfda64d583'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.635529 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe6ac0ff6fc54dec8d7ddbbfda64d583'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.636177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe6ac0ff6fc54dec8d7ddbbfda64d583'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.648906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe6ac0ff6fc54dec8d7ddbbfda64d583'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:12.724914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1057/2131] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:10:12 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:12.726112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f354b0-3bac-4301-bb40-4143879c68ae admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:12.728482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-16f354b0-3bac-4301-bb40-4143879c68ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:12.779084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1075/2132] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:10:12 2022] DELETE /identity/v3/users/fe6ac0ff6fc54dec8d7ddbbfda64d583 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:12.801618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f354b0-3bac-4301-bb40-4143879c68ae admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:12.869246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997b5bb-daab-44d6-adc0-80a9f637cbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:12.870285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997b5bb-daab-44d6-adc0-80a9f637cbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:12.870658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997b5bb-daab-44d6-adc0-80a9f637cbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:12.871201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997b5bb-daab-44d6-adc0-80a9f637cbf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:12.872451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997b5bb-daab-44d6-adc0-80a9f637cbf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:12.874744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997b5bb-daab-44d6-adc0-80a9f637cbf6 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:12.972454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1058/2133] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:10:12 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:10:12.976718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:12.986931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe2e27-435e-4a3c-9597-8ffb5d04549a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:12.996213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a40dc6-9434-4fa4-8f3b-f676fe129a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:12.996737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40dc6-9434-4fa4-8f3b-f676fe129a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:12.997120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40dc6-9434-4fa4-8f3b-f676fe129a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:12.997629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40dc6-9434-4fa4-8f3b-f676fe129a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:12.998226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40dc6-9434-4fa4-8f3b-f676fe129a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:12.999777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40dc6-9434-4fa4-8f3b-f676fe129a28 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:13.040250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1076/2134] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:13.044295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997b5bb-daab-44d6-adc0-80a9f637cbf6 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:13.055604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997b5bb-daab-44d6-adc0-80a9f637cbf6 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:13.061292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9de035-ceca-4586-a451-c47b4f6f383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:13.061900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9de035-ceca-4586-a451-c47b4f6f383d admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:13.062003 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9de035-ceca-4586-a451-c47b4f6f383d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:13.062266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9de035-ceca-4586-a451-c47b4f6f383d admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:13.063001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9de035-ceca-4586-a451-c47b4f6f383d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:13.064645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9de035-ceca-4586-a451-c47b4f6f383d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:13.078602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1059/2135] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:13.079851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a40dc6-9434-4fa4-8f3b-f676fe129a28 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:13.095908 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a40dc6-9434-4fa4-8f3b-f676fe129a28 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:13.101931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757a449-8dda-42f4-9bf3-1c2ba9d346c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:13.102724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757a449-8dda-42f4-9bf3-1c2ba9d346c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:13.103273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757a449-8dda-42f4-9bf3-1c2ba9d346c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:13.103769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757a449-8dda-42f4-9bf3-1c2ba9d346c6 admin admin] PATH_INFO: `/v3/projects/d7bbb46d7be74305940efa4cfb6a4987/users/22295d287e9d42b8906c723b85f3a3d3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:13.125207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757a449-8dda-42f4-9bf3-1c2ba9d346c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bbb46d7be74305940efa4cfb6a4987, user_id=22295d287e9d42b8906c723b85f3a3d3, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:13.132017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757a449-8dda-42f4-9bf3-1c2ba9d346c6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:13.247593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1077/2136] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:13 2022] PUT /identity/v3/projects/d7bbb46d7be74305940efa4cfb6a4987/users/22295d287e9d42b8906c723b85f3a3d3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:13.258588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769067a7-95b9-4bf1-b204-acc90e9298c3 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:13.258870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769067a7-95b9-4bf1-b204-acc90e9298c3 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:13.259143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769067a7-95b9-4bf1-b204-acc90e9298c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:13.287925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-769067a7-95b9-4bf1-b204-acc90e9298c3 None None] MFA Rules not processed for user `22295d287e9d42b8906c723b85f3a3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:13.289171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-769067a7-95b9-4bf1-b204-acc90e9298c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:13.335820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757a449-8dda-42f4-9bf3-1c2ba9d346c6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:13.337994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8757a449-8dda-42f4-9bf3-1c2ba9d346c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:13.370577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1060/2137] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:13.376244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769067a7-95b9-4bf1-b204-acc90e9298c3 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:13.428815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757a449-8dda-42f4-9bf3-1c2ba9d346c6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:13.433928 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:13.434568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:13.435031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:13.435299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] PATH_INFO: `/v3/projects/83c29a1164f54ad7bd76a810cc4b7abd` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:13.436497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c29a1164f54ad7bd76a810cc4b7abd)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:13.438621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:13.450753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769067a7-95b9-4bf1-b204-acc90e9298c3 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:13.455203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae3311-0242-4fd2-888a-aad795cd600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:13.455817 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae3311-0242-4fd2-888a-aad795cd600d admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:13.456089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae3311-0242-4fd2-888a-aad795cd600d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:13.456360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae3311-0242-4fd2-888a-aad795cd600d admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:13.457072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae3311-0242-4fd2-888a-aad795cd600d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:13.459502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae3311-0242-4fd2-888a-aad795cd600d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:13.551515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1061/2138] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:10:13 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:10:13.555421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae3311-0242-4fd2-888a-aad795cd600d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:13.577055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c29a1164f54ad7bd76a810cc4b7abd', 'request_id': 'req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:13.669715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae3311-0242-4fd2-888a-aad795cd600d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:13.697715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c29a1164f54ad7bd76a810cc4b7abd', 'request_id': 'req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:13.707402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c29a1164f54ad7bd76a810cc4b7abd', 'request_id': 'req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:13.720693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] The token cache is being invalidate because project 83c29a1164f54ad7bd76a810cc4b7abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:13.721098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:13.721782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:13.723578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1078/2139] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:13 2022] DELETE /identity/v3/projects/83c29a1164f54ad7bd76a810cc4b7abd => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:13.728662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:13.731877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:13.742054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adc551-3e41-40ea-81f3-3dabe0ac7d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:13.742718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adc551-3e41-40ea-81f3-3dabe0ac7d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:13.743398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adc551-3e41-40ea-81f3-3dabe0ac7d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:13.743862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adc551-3e41-40ea-81f3-3dabe0ac7d64 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:13.744528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adc551-3e41-40ea-81f3-3dabe0ac7d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:13.747673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adc551-3e41-40ea-81f3-3dabe0ac7d64 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:13.796897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f93dea-9e2a-4a54-b93b-ba7a8ae3b17f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:13.801782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:13.802420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:13.802703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:13.803010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] PATH_INFO: `/v3/users/245198a659744a7cb3bb44a71ced19e3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:13.804191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245198a659744a7cb3bb44a71ced19e3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:13.806232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:13.886921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1062/2140] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:10:13 2022] POST /identity/v3/users => generated 297 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:13.887944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adc551-3e41-40ea-81f3-3dabe0ac7d64 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:13.889658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-82adc551-3e41-40ea-81f3-3dabe0ac7d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:13.902060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adc551-3e41-40ea-81f3-3dabe0ac7d64 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:13.907150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70e147-a308-4416-9504-73d72db4bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:13.909816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70e147-a308-4416-9504-73d72db4bc5c admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:13.909816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70e147-a308-4416-9504-73d72db4bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:13.909816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70e147-a308-4416-9504-73d72db4bc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:13.909816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70e147-a308-4416-9504-73d72db4bc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:13.910770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70e147-a308-4416-9504-73d72db4bc5c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:13.921860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1063/2141] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:13.925965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70e147-a308-4416-9504-73d72db4bc5c admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:13.937469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70e147-a308-4416-9504-73d72db4bc5c admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:13.953886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6db03-3182-473b-aa79-29c95a69308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:13.955456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6db03-3182-473b-aa79-29c95a69308c admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:13.956022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6db03-3182-473b-aa79-29c95a69308c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:13.956547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6db03-3182-473b-aa79-29c95a69308c admin admin] PATH_INFO: `/v3/projects/8a1a0778869345539780c79216eb0e25/users/a64f9e85df2146f6bc68deed61764f95/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:13.992292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6db03-3182-473b-aa79-29c95a69308c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1a0778869345539780c79216eb0e25, user_id=a64f9e85df2146f6bc68deed61764f95, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:13.992292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6db03-3182-473b-aa79-29c95a69308c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:14.097646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1064/2142] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:13 2022] PUT /identity/v3/projects/8a1a0778869345539780c79216eb0e25/users/a64f9e85df2146f6bc68deed61764f95/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:14.101841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6db03-3182-473b-aa79-29c95a69308c admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:14.107385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245198a659744a7cb3bb44a71ced19e3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:14.108740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245198a659744a7cb3bb44a71ced19e3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:14.116727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245198a659744a7cb3bb44a71ced19e3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:14.117527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245198a659744a7cb3bb44a71ced19e3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:14.132714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c6968bd6-d464-488a-b2ff-857261c77670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245198a659744a7cb3bb44a71ced19e3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:14.172014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6db03-3182-473b-aa79-29c95a69308c admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:14.176760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561287af-a456-4e1d-9dfc-c0d0636ec400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:14.181024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561287af-a456-4e1d-9dfc-c0d0636ec400 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:14.181024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561287af-a456-4e1d-9dfc-c0d0636ec400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:14.181024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561287af-a456-4e1d-9dfc-c0d0636ec400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:14.181024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561287af-a456-4e1d-9dfc-c0d0636ec400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:14.181024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561287af-a456-4e1d-9dfc-c0d0636ec400 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:14.190059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1065/2143] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:14.194057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561287af-a456-4e1d-9dfc-c0d0636ec400 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:14.195781 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-561287af-a456-4e1d-9dfc-c0d0636ec400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:14.208417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561287af-a456-4e1d-9dfc-c0d0636ec400 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:14.212488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1079/2144] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:10:13 2022] DELETE /identity/v3/users/245198a659744a7cb3bb44a71ced19e3 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:14.213367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf2d0a-12fa-4c3b-98f2-9039b9d3ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:14.221388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2d0a-12fa-4c3b-98f2-9039b9d3ac80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:14.221388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2d0a-12fa-4c3b-98f2-9039b9d3ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:14.221388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf2d0a-12fa-4c3b-98f2-9039b9d3ac80 admin admin] PATH_INFO: `/v3/projects/8a1a0778869345539780c79216eb0e25/users/a64f9e85df2146f6bc68deed61764f95/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:14.221388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf2d0a-12fa-4c3b-98f2-9039b9d3ac80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1a0778869345539780c79216eb0e25, user_id=a64f9e85df2146f6bc68deed61764f95, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:14.221388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf2d0a-12fa-4c3b-98f2-9039b9d3ac80 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:14.230176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1066/2145] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:14 2022] PUT /identity/v3/projects/8a1a0778869345539780c79216eb0e25/users/a64f9e85df2146f6bc68deed61764f95/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:14.240634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe9462-75e3-4f8e-8b16-13aa57906ef0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:14.241215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe9462-75e3-4f8e-8b16-13aa57906ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:14.241600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe9462-75e3-4f8e-8b16-13aa57906ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:14.273077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-93fe9462-75e3-4f8e-8b16-13aa57906ef0 None None] MFA Rules not processed for user `a64f9e85df2146f6bc68deed61764f95`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:14.274426 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-93fe9462-75e3-4f8e-8b16-13aa57906ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:14.343404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1080/2146] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:14.355807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf2d0a-12fa-4c3b-98f2-9039b9d3ac80 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:14.357585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-46bf2d0a-12fa-4c3b-98f2-9039b9d3ac80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:14.414862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf2d0a-12fa-4c3b-98f2-9039b9d3ac80 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:14.419182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b40c79-d9af-4044-ba51-9727d58f0a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:14.419866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40c79-d9af-4044-ba51-9727d58f0a02 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:14.420152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40c79-d9af-4044-ba51-9727d58f0a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:14.420452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40c79-d9af-4044-ba51-9727d58f0a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:14.430882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b40c79-d9af-4044-ba51-9727d58f0a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:14.432999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b40c79-d9af-4044-ba51-9727d58f0a02 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:14.444899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1067/2147] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:14.601395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe9462-75e3-4f8e-8b16-13aa57906ef0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:14.618168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe9462-75e3-4f8e-8b16-13aa57906ef0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:14.624584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19804c4-4617-4934-8cb1-a02051dbd995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:14.625808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19804c4-4617-4934-8cb1-a02051dbd995 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:14.636190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19804c4-4617-4934-8cb1-a02051dbd995 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:14.636190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19804c4-4617-4934-8cb1-a02051dbd995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:14.636190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f19804c4-4617-4934-8cb1-a02051dbd995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:14.704431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19804c4-4617-4934-8cb1-a02051dbd995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:14.705971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19804c4-4617-4934-8cb1-a02051dbd995 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:14.725507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1081/2148] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:14.923992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b40c79-d9af-4044-ba51-9727d58f0a02 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:14.931192 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c3b40c79-d9af-4044-ba51-9727d58f0a02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:15.040724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b40c79-d9af-4044-ba51-9727d58f0a02 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:15.047888 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:15.049194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:15.049551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:15.050082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] PATH_INFO: `/v3/projects/5f3b7ffb52964194b3d0e0a33a28f398` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:15.065399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3b7ffb52964194b3d0e0a33a28f398)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:15.067658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:15.206465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3b7ffb52964194b3d0e0a33a28f398', 'request_id': 'req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:15.216534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3b7ffb52964194b3d0e0a33a28f398', 'request_id': 'req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:15.293170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3b7ffb52964194b3d0e0a33a28f398', 'request_id': 'req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:15.309685 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] The token cache is being invalidate because project 5f3b7ffb52964194b3d0e0a33a28f398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:15.310471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:15.311333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:15.318765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1068/2149] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:14 2022] DELETE /identity/v3/projects/5f3b7ffb52964194b3d0e0a33a28f398 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:15.321210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f68d-5e97-48d6-bc07-703ec35f326b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:15.321664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f68d-5e97-48d6-bc07-703ec35f326b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:15.321956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527f68d-5e97-48d6-bc07-703ec35f326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:15.347819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3527f68d-5e97-48d6-bc07-703ec35f326b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:15.349613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3527f68d-5e97-48d6-bc07-703ec35f326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:15.408918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:15.411010 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:15.421485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1082/2150] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:15.428772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890df1-ce34-4644-ab75-f2fb922c71b8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:15.429123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890df1-ce34-4644-ab75-f2fb922c71b8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:15.429397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890df1-ce34-4644-ab75-f2fb922c71b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:15.436354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d29aa-b47a-4f84-a5cc-8eaf1a9c1823 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:15.444236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:15.445638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:15.445638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:15.445638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] PATH_INFO: `/v3/users/22295d287e9d42b8906c723b85f3a3d3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:15.446791 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22295d287e9d42b8906c723b85f3a3d3)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:15.449159 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:15.465912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-94890df1-ce34-4644-ab75-f2fb922c71b8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:15.467149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-94890df1-ce34-4644-ab75-f2fb922c71b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:15.477232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1083/2151] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:15.481493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890df1-ce34-4644-ab75-f2fb922c71b8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:15.490861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890df1-ce34-4644-ab75-f2fb922c71b8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:15.495421 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2c7b8-d6ac-4aac-ad68-86aa46f3b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:15.496022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2c7b8-d6ac-4aac-ad68-86aa46f3b5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:15.496297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2c7b8-d6ac-4aac-ad68-86aa46f3b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:15.496591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2c7b8-d6ac-4aac-ad68-86aa46f3b5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:15.497343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2c7b8-d6ac-4aac-ad68-86aa46f3b5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:10:15.497644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2c7b8-d6ac-4aac-ad68-86aa46f3b5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:15.499229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2c7b8-d6ac-4aac-ad68-86aa46f3b5c9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:15.510861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1084/2152] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:10:15.515110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2c7b8-d6ac-4aac-ad68-86aa46f3b5c9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:15.524764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2c7b8-d6ac-4aac-ad68-86aa46f3b5c9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:15.529285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a8f1e-1de2-4a79-bffd-16bec0cc632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:15.529854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a8f1e-1de2-4a79-bffd-16bec0cc632f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:15.530127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a8f1e-1de2-4a79-bffd-16bec0cc632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:15.530395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a8f1e-1de2-4a79-bffd-16bec0cc632f admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:15.531036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a8f1e-1de2-4a79-bffd-16bec0cc632f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:15.532905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a8f1e-1de2-4a79-bffd-16bec0cc632f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:15.678853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1085/2153] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:10:15 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:15.684057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a8f1e-1de2-4a79-bffd-16bec0cc632f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:15.750505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a8f1e-1de2-4a79-bffd-16bec0cc632f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:15.755692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3918e76-1e6a-4ac5-b20d-df9fef6b218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:15.756307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3918e76-1e6a-4ac5-b20d-df9fef6b218f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:15.756613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3918e76-1e6a-4ac5-b20d-df9fef6b218f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:15.756913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3918e76-1e6a-4ac5-b20d-df9fef6b218f admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:15.757578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3918e76-1e6a-4ac5-b20d-df9fef6b218f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:15.759471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3918e76-1e6a-4ac5-b20d-df9fef6b218f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:15.879862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1086/2154] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:10:15 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:15.883919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3918e76-1e6a-4ac5-b20d-df9fef6b218f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:15.893648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22295d287e9d42b8906c723b85f3a3d3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:15.894372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22295d287e9d42b8906c723b85f3a3d3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:15.900268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3918e76-1e6a-4ac5-b20d-df9fef6b218f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:15.905004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdce89-fc0c-42a8-8ace-2d4401911717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:15.906129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdce89-fc0c-42a8-8ace-2d4401911717 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:15.906544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdce89-fc0c-42a8-8ace-2d4401911717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:15.906948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdce89-fc0c-42a8-8ace-2d4401911717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:15.907905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdce89-fc0c-42a8-8ace-2d4401911717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:15.909683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdce89-fc0c-42a8-8ace-2d4401911717 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:15.922631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1087/2155] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:15.932288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdce89-fc0c-42a8-8ace-2d4401911717 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:15.943840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdce89-fc0c-42a8-8ace-2d4401911717 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:15.950131 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7487e7d-d27a-4fb4-a314-a3e8f37451fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:15.950758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7487e7d-d27a-4fb4-a314-a3e8f37451fd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:15.951139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7487e7d-d27a-4fb4-a314-a3e8f37451fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:15.959986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7487e7d-d27a-4fb4-a314-a3e8f37451fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:15.960890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7487e7d-d27a-4fb4-a314-a3e8f37451fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:15.962788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7487e7d-d27a-4fb4-a314-a3e8f37451fd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:15.974732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1088/2156] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:15.982531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7487e7d-d27a-4fb4-a314-a3e8f37451fd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:15.997957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7487e7d-d27a-4fb4-a314-a3e8f37451fd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:16.004823 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f7af-0f6d-4e4a-ac8c-ff78ffc22a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:16.005433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f7af-0f6d-4e4a-ac8c-ff78ffc22a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:16.005711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f7af-0f6d-4e4a-ac8c-ff78ffc22a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:16.005983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f7af-0f6d-4e4a-ac8c-ff78ffc22a07 admin admin] PATH_INFO: `/v3/projects/e8b085b6b06e4570b7c3480e47df75ab/users/b4d33ddee70c44369132c46754dab7e6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:16.022265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f7af-0f6d-4e4a-ac8c-ff78ffc22a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b085b6b06e4570b7c3480e47df75ab, user_id=b4d33ddee70c44369132c46754dab7e6, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:16.024835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22295d287e9d42b8906c723b85f3a3d3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:16.025480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22295d287e9d42b8906c723b85f3a3d3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:16.029762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f7af-0f6d-4e4a-ac8c-ff78ffc22a07 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:16.036864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:16.042596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-161bc327-01b6-402a-bf17-54c57ff97502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22295d287e9d42b8906c723b85f3a3d3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:16.057693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1069/2157] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:10:15 2022] DELETE /identity/v3/users/22295d287e9d42b8906c723b85f3a3d3 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:16.062112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebe73c-0ed5-4136-ba78-7395a1619db7 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:16.062513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebe73c-0ed5-4136-ba78-7395a1619db7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:16.062870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebe73c-0ed5-4136-ba78-7395a1619db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:16.083563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b7ebe73c-0ed5-4136-ba78-7395a1619db7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:16.084926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b7ebe73c-0ed5-4136-ba78-7395a1619db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:16.151616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1070/2158] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:16.164134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebe73c-0ed5-4136-ba78-7395a1619db7 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:16.166027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b7ebe73c-0ed5-4136-ba78-7395a1619db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:16.188882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1089/2159] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:15 2022] PUT /identity/v3/projects/e8b085b6b06e4570b7c3480e47df75ab/users/b4d33ddee70c44369132c46754dab7e6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:16.198239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feda4c-b7b1-40e7-b88d-0f7f512490a1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:16.198526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feda4c-b7b1-40e7-b88d-0f7f512490a1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:16.198803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feda4c-b7b1-40e7-b88d-0f7f512490a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:16.232715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a7feda4c-b7b1-40e7-b88d-0f7f512490a1 None None] MFA Rules not processed for user `b4d33ddee70c44369132c46754dab7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:16.233980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a7feda4c-b7b1-40e7-b88d-0f7f512490a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:16.284695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebe73c-0ed5-4136-ba78-7395a1619db7 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:16.357982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3815fc-6638-462d-8dba-6b50631ecf82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:16.363266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1090/2160] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:16.366499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3815fc-6638-462d-8dba-6b50631ecf82 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:16.366784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3815fc-6638-462d-8dba-6b50631ecf82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:16.367118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3815fc-6638-462d-8dba-6b50631ecf82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:16.374049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feda4c-b7b1-40e7-b88d-0f7f512490a1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:16.375897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a7feda4c-b7b1-40e7-b88d-0f7f512490a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:16.435586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3815fc-6638-462d-8dba-6b50631ecf82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:16.437089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3815fc-6638-462d-8dba-6b50631ecf82 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:16.447872 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1071/2161] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:10:16.460365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feda4c-b7b1-40e7-b88d-0f7f512490a1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:16.466771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7e68-ec47-4eef-9f7b-79e22bcb8ec6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18138af1ea504faca84b0cc2034ddd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:16.466771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7e68-ec47-4eef-9f7b-79e22bcb8ec6 service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:16.466771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7e68-ec47-4eef-9f7b-79e22bcb8ec6 service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:16.466771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7e68-ec47-4eef-9f7b-79e22bcb8ec6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:16.474343 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b7e68-ec47-4eef-9f7b-79e22bcb8ec6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:16.475981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b7e68-ec47-4eef-9f7b-79e22bcb8ec6 service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:16.487038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1091/2162] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:10:16.923926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3815fc-6638-462d-8dba-6b50631ecf82 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:16.925910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-db3815fc-6638-462d-8dba-6b50631ecf82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:16.940492 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3815fc-6638-462d-8dba-6b50631ecf82 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:16.945740 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:16.946384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:16.946659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:16.946932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] PATH_INFO: `/v3/projects/d7bbb46d7be74305940efa4cfb6a4987` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:16.948134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bbb46d7be74305940efa4cfb6a4987)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:16.954182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:17.133546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bbb46d7be74305940efa4cfb6a4987', 'request_id': 'req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.139449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bbb46d7be74305940efa4cfb6a4987', 'request_id': 'req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.245635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bbb46d7be74305940efa4cfb6a4987', 'request_id': 'req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.250307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:17.273519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] The token cache is being invalidate because project d7bbb46d7be74305940efa4cfb6a4987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:17.273908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.274484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.276163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1072/2163] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:16 2022] DELETE /identity/v3/projects/d7bbb46d7be74305940efa4cfb6a4987 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:17.280135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7e68-ec47-4eef-9f7b-79e22bcb8ec6 service glance] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:17.295160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7e68-ec47-4eef-9f7b-79e22bcb8ec6 service glance] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:17.400181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:17.401771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:17.402206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:17.402640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] PATH_INFO: `/v3/users/a64f9e85df2146f6bc68deed61764f95` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:17.404751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64f9e85df2146f6bc68deed61764f95)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:17.407243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:17.791213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64f9e85df2146f6bc68deed61764f95'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.791959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64f9e85df2146f6bc68deed61764f95'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.799119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64f9e85df2146f6bc68deed61764f95'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.799857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64f9e85df2146f6bc68deed61764f95'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.812078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6f6021a-2a64-4654-ae18-ecbc73ba9682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64f9e85df2146f6bc68deed61764f95'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:17.943027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1092/2164] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:10:17 2022] DELETE /identity/v3/users/a64f9e85df2146f6bc68deed61764f95 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:18.401914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:18.403825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:18.437039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5d0b3-1ba0-4d09-9fab-b75711e594ec admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:18.510717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:18.510892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:18.511394 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:18.511596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] PATH_INFO: `/v3/projects/8a1a0778869345539780c79216eb0e25` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:18.512726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1a0778869345539780c79216eb0e25)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:18.514716 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:18.775355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1a0778869345539780c79216eb0e25', 'request_id': 'req-2d63abd3-5643-40df-8b9a-2984328a3bf6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:18.781794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1a0778869345539780c79216eb0e25', 'request_id': 'req-2d63abd3-5643-40df-8b9a-2984328a3bf6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:18.959469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1a0778869345539780c79216eb0e25', 'request_id': 'req-2d63abd3-5643-40df-8b9a-2984328a3bf6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:18.971338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] The token cache is being invalidate because project 8a1a0778869345539780c79216eb0e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:18.974636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:18.974636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-2d63abd3-5643-40df-8b9a-2984328a3bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:18.974636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1073/2165] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:18 2022] DELETE /identity/v3/projects/8a1a0778869345539780c79216eb0e25 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:18.979893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e05364-0ad0-456d-854d-e17f636e146a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:18.980329 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e05364-0ad0-456d-854d-e17f636e146a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:18.980590 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e05364-0ad0-456d-854d-e17f636e146a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.002610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-95e05364-0ad0-456d-854d-e17f636e146a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:19.002610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-95e05364-0ad0-456d-854d-e17f636e146a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:19.074634 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1093/2166] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:19.082567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faff373-a503-40fb-b082-91a6496c970b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.082902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faff373-a503-40fb-b082-91a6496c970b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.083183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faff373-a503-40fb-b082-91a6496c970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.108574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2faff373-a503-40fb-b082-91a6496c970b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:19.109834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2faff373-a503-40fb-b082-91a6496c970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:19.119830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1074/2167] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:19.124088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e05364-0ad0-456d-854d-e17f636e146a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:19.134374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e05364-0ad0-456d-854d-e17f636e146a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:19.139887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14436edd-b428-41cc-a2be-07c76a11dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:19.140440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14436edd-b428-41cc-a2be-07c76a11dbef admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.140721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14436edd-b428-41cc-a2be-07c76a11dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.141022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14436edd-b428-41cc-a2be-07c76a11dbef admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.141709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14436edd-b428-41cc-a2be-07c76a11dbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:10:19.142006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14436edd-b428-41cc-a2be-07c76a11dbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:19.143753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14436edd-b428-41cc-a2be-07c76a11dbef admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:19.155954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1094/2168] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:10:19.161104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faff373-a503-40fb-b082-91a6496c970b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:19.179886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faff373-a503-40fb-b082-91a6496c970b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:19.179886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa285a-ff15-41e0-ace1-830f37e041b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:19.179886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa285a-ff15-41e0-ace1-830f37e041b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.179886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa285a-ff15-41e0-ace1-830f37e041b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.180182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa285a-ff15-41e0-ace1-830f37e041b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.180552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa285a-ff15-41e0-ace1-830f37e041b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:19.182505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa285a-ff15-41e0-ace1-830f37e041b9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:19.323257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1075/2169] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:10:19 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:10:19.327354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14436edd-b428-41cc-a2be-07c76a11dbef admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:19.347687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14436edd-b428-41cc-a2be-07c76a11dbef admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:19.445749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:19.472348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33252e-668d-4510-a6de-d397248a8105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:19.475026 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33252e-668d-4510-a6de-d397248a8105 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.475173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33252e-668d-4510-a6de-d397248a8105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.475723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33252e-668d-4510-a6de-d397248a8105 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.476671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33252e-668d-4510-a6de-d397248a8105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:19.481397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33252e-668d-4510-a6de-d397248a8105 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:19.669488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1095/2170] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:10:19 2022] POST /identity/v3/users => generated 288 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:10:19.672383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa285a-ff15-41e0-ace1-830f37e041b9 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:19.683483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa285a-ff15-41e0-ace1-830f37e041b9 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:19.688042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79f63-20aa-4b58-a3b4-f63303d74b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:19.688694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79f63-20aa-4b58-a3b4-f63303d74b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.688963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79f63-20aa-4b58-a3b4-f63303d74b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.689239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79f63-20aa-4b58-a3b4-f63303d74b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.690008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79f63-20aa-4b58-a3b4-f63303d74b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:19.691628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79f63-20aa-4b58-a3b4-f63303d74b2e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:19.704907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1076/2171] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:19.706208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33252e-668d-4510-a6de-d397248a8105 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:19.719626 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33252e-668d-4510-a6de-d397248a8105 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:19.725354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd8742-a5aa-4264-a76d-1c26097533d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:19.728694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd8742-a5aa-4264-a76d-1c26097533d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.728694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd8742-a5aa-4264-a76d-1c26097533d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.728694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd8742-a5aa-4264-a76d-1c26097533d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.728694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd8742-a5aa-4264-a76d-1c26097533d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:19.729081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd8742-a5aa-4264-a76d-1c26097533d2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:19.744620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1096/2172] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:19.746059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79f63-20aa-4b58-a3b4-f63303d74b2e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:19.756925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79f63-20aa-4b58-a3b4-f63303d74b2e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:19.762411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b894cb-7d2b-4f88-8570-75080252dc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:19.763471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b894cb-7d2b-4f88-8570-75080252dc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.763758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b894cb-7d2b-4f88-8570-75080252dc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.764060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b894cb-7d2b-4f88-8570-75080252dc52 admin admin] PATH_INFO: `/v3/projects/899585ca29f44710b1d565aa307c00df/users/c882fc8aa3fe4c27b9475276469d6ed2/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:19.797379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b894cb-7d2b-4f88-8570-75080252dc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899585ca29f44710b1d565aa307c00df, user_id=c882fc8aa3fe4c27b9475276469d6ed2, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:19.797379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b894cb-7d2b-4f88-8570-75080252dc52 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:19.881179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1077/2173] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:19 2022] PUT /identity/v3/projects/899585ca29f44710b1d565aa307c00df/users/c882fc8aa3fe4c27b9475276469d6ed2/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:19.955042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027fa6-e3c0-45a2-a0c1-fda82181586d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:19.960149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027fa6-e3c0-45a2-a0c1-fda82181586d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:19.960149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027fa6-e3c0-45a2-a0c1-fda82181586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.001142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-13027fa6-e3c0-45a2-a0c1-fda82181586d None None] MFA Rules not processed for user `c882fc8aa3fe4c27b9475276469d6ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:20.002392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-13027fa6-e3c0-45a2-a0c1-fda82181586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:20.091192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1097/2174] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:20.095850 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b894cb-7d2b-4f88-8570-75080252dc52 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:20.171273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b894cb-7d2b-4f88-8570-75080252dc52 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:20.178573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93538da8-dc73-4221-b972-c9569677a9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:20.179669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93538da8-dc73-4221-b972-c9569677a9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:20.179938 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93538da8-dc73-4221-b972-c9569677a9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:20.180205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93538da8-dc73-4221-b972-c9569677a9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.180900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93538da8-dc73-4221-b972-c9569677a9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:20.183638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93538da8-dc73-4221-b972-c9569677a9d2 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:20.228519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:20.335262 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1078/2175] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:10:20 2022] POST /identity/v3/projects => generated 373 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:10:20.342017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027fa6-e3c0-45a2-a0c1-fda82181586d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:20.353151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027fa6-e3c0-45a2-a0c1-fda82181586d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:20.418517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269be408-ab22-4c53-a6d9-05b58303186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:20.427777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269be408-ab22-4c53-a6d9-05b58303186b admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:20.427777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269be408-ab22-4c53-a6d9-05b58303186b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:20.427777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269be408-ab22-4c53-a6d9-05b58303186b admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.427777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269be408-ab22-4c53-a6d9-05b58303186b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:20.427777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269be408-ab22-4c53-a6d9-05b58303186b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:20.554680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1098/2176] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:10:20 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:10:20.565059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93538da8-dc73-4221-b972-c9569677a9d2 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:20.575952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93538da8-dc73-4221-b972-c9569677a9d2 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:20.585564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2093b-9b32-4e9d-b45e-cba350d6393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:20.585564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2093b-9b32-4e9d-b45e-cba350d6393a admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:20.585564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2093b-9b32-4e9d-b45e-cba350d6393a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:20.585564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2093b-9b32-4e9d-b45e-cba350d6393a admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.595448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2093b-9b32-4e9d-b45e-cba350d6393a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:20.598754 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2093b-9b32-4e9d-b45e-cba350d6393a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:20.611181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1079/2177] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:20.615396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269be408-ab22-4c53-a6d9-05b58303186b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:20.625629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269be408-ab22-4c53-a6d9-05b58303186b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:20.630823 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f83bb6-e37a-4c3b-9450-8d0a43f5b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:20.633088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f83bb6-e37a-4c3b-9450-8d0a43f5b642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:20.633088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f83bb6-e37a-4c3b-9450-8d0a43f5b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:20.633088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f83bb6-e37a-4c3b-9450-8d0a43f5b642 admin admin] PATH_INFO: `/v3/projects/2201244a93454f1081f8c504e9359645/users/d0ab32842cf24b91b6143638d1280d2c/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.648727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f83bb6-e37a-4c3b-9450-8d0a43f5b642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2201244a93454f1081f8c504e9359645, user_id=d0ab32842cf24b91b6143638d1280d2c, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:20.651573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f83bb6-e37a-4c3b-9450-8d0a43f5b642 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:20.780306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1099/2178] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:20 2022] PUT /identity/v3/projects/2201244a93454f1081f8c504e9359645/users/d0ab32842cf24b91b6143638d1280d2c/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:20.786183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2093b-9b32-4e9d-b45e-cba350d6393a admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:20.796295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2093b-9b32-4e9d-b45e-cba350d6393a admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:20.876499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665dba-69c1-40bb-88a3-f644f3f0b21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:20.876499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665dba-69c1-40bb-88a3-f644f3f0b21e admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:20.876499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665dba-69c1-40bb-88a3-f644f3f0b21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:20.876499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665dba-69c1-40bb-88a3-f644f3f0b21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.877095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48665dba-69c1-40bb-88a3-f644f3f0b21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:20.877095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48665dba-69c1-40bb-88a3-f644f3f0b21e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:20.883034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1080/2179] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:10:20.887010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f83bb6-e37a-4c3b-9450-8d0a43f5b642 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:20.898199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f83bb6-e37a-4c3b-9450-8d0a43f5b642 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:20.903914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0236d2-8f75-46bb-a9ec-3d00618b1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:20.904579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0236d2-8f75-46bb-a9ec-3d00618b1313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:20.904887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0236d2-8f75-46bb-a9ec-3d00618b1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:20.905161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0236d2-8f75-46bb-a9ec-3d00618b1313 admin admin] PATH_INFO: `/v3/projects/2201244a93454f1081f8c504e9359645/users/d0ab32842cf24b91b6143638d1280d2c/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.907101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0236d2-8f75-46bb-a9ec-3d00618b1313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2201244a93454f1081f8c504e9359645, user_id=d0ab32842cf24b91b6143638d1280d2c, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:20.909786 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0236d2-8f75-46bb-a9ec-3d00618b1313 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:20.922374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1100/2180] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:10:20 2022] PUT /identity/v3/projects/2201244a93454f1081f8c504e9359645/users/d0ab32842cf24b91b6143638d1280d2c/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:20.933144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278833c3-6ea3-44eb-907c-e72063b0e523 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:20.934602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278833c3-6ea3-44eb-907c-e72063b0e523 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:20.934602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278833c3-6ea3-44eb-907c-e72063b0e523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:20.968600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-278833c3-6ea3-44eb-907c-e72063b0e523 None None] MFA Rules not processed for user `d0ab32842cf24b91b6143638d1280d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:20.969868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-278833c3-6ea3-44eb-907c-e72063b0e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:21.057203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1081/2181] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:21.068367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0236d2-8f75-46bb-a9ec-3d00618b1313 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:21.070293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2f0236d2-8f75-46bb-a9ec-3d00618b1313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:21.132855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0236d2-8f75-46bb-a9ec-3d00618b1313 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:21.136556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10272a-09db-4091-9dbe-ff2f13a3755b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:21.137229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10272a-09db-4091-9dbe-ff2f13a3755b service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:21.137509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10272a-09db-4091-9dbe-ff2f13a3755b service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:21.137784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10272a-09db-4091-9dbe-ff2f13a3755b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:21.230107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10272a-09db-4091-9dbe-ff2f13a3755b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:21.231829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10272a-09db-4091-9dbe-ff2f13a3755b service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:21.247272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1101/2182] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:23.030951 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:24.349248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:25.144174 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639ed48-910c-49f3-abf2-8c1fd5ca78e5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:25.144495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639ed48-910c-49f3-abf2-8c1fd5ca78e5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:25.145350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639ed48-910c-49f3-abf2-8c1fd5ca78e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:25.164490 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7639ed48-910c-49f3-abf2-8c1fd5ca78e5 None None] MFA Rules not processed for user `9b585090272c4b4ab7d1937ebc9fa649`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:25.165796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7639ed48-910c-49f3-abf2-8c1fd5ca78e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:25.222456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1082/2183] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:25.535141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:25.800907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10272a-09db-4091-9dbe-ff2f13a3755b service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:25.866906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10272a-09db-4091-9dbe-ff2f13a3755b service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:25.871620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:25.872263 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:25.872555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:25.872972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] PATH_INFO: `/v3/users/c882fc8aa3fe4c27b9475276469d6ed2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:25.874195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c882fc8aa3fe4c27b9475276469d6ed2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:25.876972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:26.100313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c882fc8aa3fe4c27b9475276469d6ed2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:26.101007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c882fc8aa3fe4c27b9475276469d6ed2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:26.107924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c882fc8aa3fe4c27b9475276469d6ed2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:26.108594 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c882fc8aa3fe4c27b9475276469d6ed2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:26.128736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c882fc8aa3fe4c27b9475276469d6ed2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:26.219031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1102/2184] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:10:25 2022] DELETE /identity/v3/users/c882fc8aa3fe4c27b9475276469d6ed2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:26.224208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d7353-34f2-40c5-92f9-74f823025497 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:26.224670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d7353-34f2-40c5-92f9-74f823025497 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:26.224772 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d7353-34f2-40c5-92f9-74f823025497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:26.243713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-d41d7353-34f2-40c5-92f9-74f823025497 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:26.244963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d41d7353-34f2-40c5-92f9-74f823025497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:26.304868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1083/2185] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:26.315635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:26.317738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:26.375711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9d870-4afb-44dd-b986-732a8a924b57 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:26.380470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5944017-9e35-4475-812f-c6588015637a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:26.381130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5944017-9e35-4475-812f-c6588015637a service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:26.381410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5944017-9e35-4475-812f-c6588015637a service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:26.381683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5944017-9e35-4475-812f-c6588015637a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:26.391143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5944017-9e35-4475-812f-c6588015637a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:26.393225 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5944017-9e35-4475-812f-c6588015637a service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:26.403148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1103/2186] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:10:26.871270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:26.942530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d7353-34f2-40c5-92f9-74f823025497 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:26.944084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d41d7353-34f2-40c5-92f9-74f823025497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:26.947012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:26.957572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d7353-34f2-40c5-92f9-74f823025497 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:26.963110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:26.963802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:26.964267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:26.964542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] PATH_INFO: `/v3/projects/899585ca29f44710b1d565aa307c00df` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:26.965833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899585ca29f44710b1d565aa307c00df)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:26.967681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:27.128627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899585ca29f44710b1d565aa307c00df', 'request_id': 'req-00fdfcaa-3e5a-4675-b6a0-75923def10c8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.134834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899585ca29f44710b1d565aa307c00df', 'request_id': 'req-00fdfcaa-3e5a-4675-b6a0-75923def10c8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.239994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899585ca29f44710b1d565aa307c00df', 'request_id': 'req-00fdfcaa-3e5a-4675-b6a0-75923def10c8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.252672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] The token cache is being invalidate because project 899585ca29f44710b1d565aa307c00df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:27.253004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.253667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.255226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1084/2187] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:26 2022] DELETE /identity/v3/projects/899585ca29f44710b1d565aa307c00df => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:27.259363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5944017-9e35-4475-812f-c6588015637a service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:27.269711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5944017-9e35-4475-812f-c6588015637a service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:27.333633 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:27.334277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:27.334691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:27.334814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] PATH_INFO: `/v3/users/d0ab32842cf24b91b6143638d1280d2c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:27.335972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ab32842cf24b91b6143638d1280d2c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:27.339859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:27.630210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ab32842cf24b91b6143638d1280d2c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.631190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ab32842cf24b91b6143638d1280d2c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.639361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ab32842cf24b91b6143638d1280d2c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.640040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ab32842cf24b91b6143638d1280d2c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.657620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9383232f-e2a8-48b3-a109-ec2e7d7bb5f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ab32842cf24b91b6143638d1280d2c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:27.774174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1104/2188] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:10:27 2022] DELETE /identity/v3/users/d0ab32842cf24b91b6143638d1280d2c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:10:28.315550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:28.317941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:28.335648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdfcaa-3e5a-4675-b6a0-75923def10c8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:28.404055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:28.404712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:28.405024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:28.405299 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] PATH_INFO: `/v3/projects/2201244a93454f1081f8c504e9359645` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:28.406461 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2201244a93454f1081f8c504e9359645)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:28.408365 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:28.539265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2201244a93454f1081f8c504e9359645', 'request_id': 'req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:28.544573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2201244a93454f1081f8c504e9359645', 'request_id': 'req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:28.613138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2201244a93454f1081f8c504e9359645', 'request_id': 'req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:28.625817 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] The token cache is being invalidate because project 2201244a93454f1081f8c504e9359645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:10:28.626164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:28.626845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:10:28.628384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1085/2189] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:10:28 2022] DELETE /identity/v3/projects/2201244a93454f1081f8c504e9359645 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:10:28.744929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:29.314288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:29.777141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:30.137097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:30.361639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:30.716563 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:30.948201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:31.293875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:31.943576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:32.455283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:33.373324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:33.930722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:34.417427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:34.651510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:35.047710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:36.171369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:36.213948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:36.847274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:36.876258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:37.006224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:37.258969 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:37.287642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:37.664884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:37.699075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:38.062642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:38.540106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef6c10-e1ca-461a-9ff7-e4f4975f71f1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:38.540699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef6c10-e1ca-461a-9ff7-e4f4975f71f1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:38.540699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef6c10-e1ca-461a-9ff7-e4f4975f71f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:38.567716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-50ef6c10-e1ca-461a-9ff7-e4f4975f71f1 None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:38.569665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-50ef6c10-e1ca-461a-9ff7-e4f4975f71f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:38.649025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1105/2190] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:10:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:10:38.716179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:38.718563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:38.799189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a1cd-0e50-4f0e-9314-8d1d36f5e599 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:38.803903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:38.806591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4a62-d60b-4ab0-a93e-439acfd3bc10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:38.807215 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4a62-d60b-4ab0-a93e-439acfd3bc10 service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:38.811459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4a62-d60b-4ab0-a93e-439acfd3bc10 service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:38.811459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4a62-d60b-4ab0-a93e-439acfd3bc10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:38.816243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe4a62-d60b-4ab0-a93e-439acfd3bc10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:38.817876 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe4a62-d60b-4ab0-a93e-439acfd3bc10 service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:38.826302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1086/2191] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:10:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:10:39.103457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:39.198409 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb2bb8-c40e-4503-a566-596646cc709e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:39.198779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb2bb8-c40e-4503-a566-596646cc709e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:39.199168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb2bb8-c40e-4503-a566-596646cc709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:39.221216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f6cb2bb8-c40e-4503-a566-596646cc709e None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:10:39.222711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f6cb2bb8-c40e-4503-a566-596646cc709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:10:39.231779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1106/2192] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:10:39.250984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4a62-d60b-4ab0-a93e-439acfd3bc10 service swift] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:10:39.266609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4a62-d60b-4ab0-a93e-439acfd3bc10 service swift] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:10:39.272146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89d59c-f633-4606-b597-366a222e9a90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:10:39.272762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d59c-f633-4606-b597-366a222e9a90 service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:10:39.273073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d59c-f633-4606-b597-366a222e9a90 service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:10:39.273348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d59c-f633-4606-b597-366a222e9a90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:10:39.282770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89d59c-f633-4606-b597-366a222e9a90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:10:39.284486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89d59c-f633-4606-b597-366a222e9a90 service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:10:39.294957 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1087/2193] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:10:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:10:40.672443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:40.774726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:41.731650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:41.768207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:42.594602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:43.007563 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:43.810131 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:44.019197 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:44.282051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:44.430693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:44.556338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:44.744643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:44.851206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.049756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.178781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.205489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.314475 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.446626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.537517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.693606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.723385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.891517 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:45.919809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:46.182241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:46.204549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:46.624497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:46.791623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:47.100153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:47.140147 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:47.352809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:47.959929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:49.207992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:49.341647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:49.773447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:49.973678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:50.140165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:59.835726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=32,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:00.227892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=16 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:02.627857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb2bb8-c40e-4503-a566-596646cc709e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:02.629854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f6cb2bb8-c40e-4503-a566-596646cc709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:02.709334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb2bb8-c40e-4503-a566-596646cc709e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:02.716129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:02.716939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:02.717326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:02.717712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] PATH_INFO: `/v3/users/b4d33ddee70c44369132c46754dab7e6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:02.719050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d33ddee70c44369132c46754dab7e6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:02.721644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:03.007428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d33ddee70c44369132c46754dab7e6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:03.008089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d33ddee70c44369132c46754dab7e6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:03.017735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d33ddee70c44369132c46754dab7e6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:03.018471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d33ddee70c44369132c46754dab7e6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:03.061850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d33ddee70c44369132c46754dab7e6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:03.156991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1107/2194] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:11:02 2022] DELETE /identity/v3/users/b4d33ddee70c44369132c46754dab7e6 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:03.159718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d05312-248f-4767-9f8c-8c290e5f7586 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:03.160242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d05312-248f-4767-9f8c-8c290e5f7586 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:03.160357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d05312-248f-4767-9f8c-8c290e5f7586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:03.187338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-d4d05312-248f-4767-9f8c-8c290e5f7586 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:03.188578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d4d05312-248f-4767-9f8c-8c290e5f7586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:03.301618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1088/2195] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:03.309009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:03.311055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:03.401097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d7253-984d-413e-99f1-d64ab596c591 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:03.405881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44170f-e336-4eed-85de-499ae9a1768e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:03.406637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44170f-e336-4eed-85de-499ae9a1768e service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:03.407008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44170f-e336-4eed-85de-499ae9a1768e service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:03.407353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44170f-e336-4eed-85de-499ae9a1768e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:03.417554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44170f-e336-4eed-85de-499ae9a1768e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:03.419146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44170f-e336-4eed-85de-499ae9a1768e service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:03.432826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1108/2196] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:11:04.100770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d05312-248f-4767-9f8c-8c290e5f7586 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:04.102386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-d4d05312-248f-4767-9f8c-8c290e5f7586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:04.120935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d05312-248f-4767-9f8c-8c290e5f7586 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:04.126622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:04.127446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:04.128648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:04.128648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] PATH_INFO: `/v3/projects/e8b085b6b06e4570b7c3480e47df75ab` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:04.129892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b085b6b06e4570b7c3480e47df75ab)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:04.131806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:04.266892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b085b6b06e4570b7c3480e47df75ab', 'request_id': 'req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:04.273253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b085b6b06e4570b7c3480e47df75ab', 'request_id': 'req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:04.349923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b085b6b06e4570b7c3480e47df75ab', 'request_id': 'req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:04.361921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] The token cache is being invalidate because project e8b085b6b06e4570b7c3480e47df75ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:11:04.362211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:04.362875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e4e0d64-c0c8-43c4-8e41-7a03f06132f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:04.364981 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1089/2197] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:11:04 2022] DELETE /identity/v3/projects/e8b085b6b06e4570b7c3480e47df75ab => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:11:04.370103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1440ab-28fe-4467-9393-6035b5b4b494 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:04.370608 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1440ab-28fe-4467-9393-6035b5b4b494 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:04.370725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1440ab-28fe-4467-9393-6035b5b4b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:04.390201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9a1440ab-28fe-4467-9393-6035b5b4b494 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:04.391427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9a1440ab-28fe-4467-9393-6035b5b4b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:04.409049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:04.461024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1109/2198] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:11:04.468056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc9a70-918b-42b1-8bb9-4247e66d74ab None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:04.468489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc9a70-918b-42b1-8bb9-4247e66d74ab None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:04.468959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc9a70-918b-42b1-8bb9-4247e66d74ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:04.489908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-6bdc9a70-918b-42b1-8bb9-4247e66d74ab None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:04.491129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6bdc9a70-918b-42b1-8bb9-4247e66d74ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:04.499134 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1090/2199] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:04.508348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1440ab-28fe-4467-9393-6035b5b4b494 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:04.518692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1440ab-28fe-4467-9393-6035b5b4b494 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:04.523616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5a3b2-de29-4cd7-b755-0b90569d3fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:04.524220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5a3b2-de29-4cd7-b755-0b90569d3fef admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:04.524501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5a3b2-de29-4cd7-b755-0b90569d3fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:04.524773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5a3b2-de29-4cd7-b755-0b90569d3fef admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:04.525494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5a3b2-de29-4cd7-b755-0b90569d3fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:11:04.525824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5a3b2-de29-4cd7-b755-0b90569d3fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:04.527735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5a3b2-de29-4cd7-b755-0b90569d3fef admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:04.540048 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1110/2200] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:11:04.544415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc9a70-918b-42b1-8bb9-4247e66d74ab None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:04.554361 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc9a70-918b-42b1-8bb9-4247e66d74ab None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:04.559151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbea652-3c72-4c03-a3a2-ddd9eafdc0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:04.559756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbea652-3c72-4c03-a3a2-ddd9eafdc0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:04.560074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbea652-3c72-4c03-a3a2-ddd9eafdc0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:04.560545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbea652-3c72-4c03-a3a2-ddd9eafdc0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:04.561266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbea652-3c72-4c03-a3a2-ddd9eafdc0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:04.563268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbea652-3c72-4c03-a3a2-ddd9eafdc0a3 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:04.726705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1091/2201] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:11:04 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:11:04.730575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5a3b2-de29-4cd7-b755-0b90569d3fef admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:04.743974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5a3b2-de29-4cd7-b755-0b90569d3fef admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:04.798748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc890-600e-4af3-a437-9816392de863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:04.799367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc890-600e-4af3-a437-9816392de863 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:04.799648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc890-600e-4af3-a437-9816392de863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:04.799920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc890-600e-4af3-a437-9816392de863 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:04.800581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc890-600e-4af3-a437-9816392de863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:04.803319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc890-600e-4af3-a437-9816392de863 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:04.925283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1111/2202] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:11:04 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:11:04.929914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbea652-3c72-4c03-a3a2-ddd9eafdc0a3 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:04.941909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbea652-3c72-4c03-a3a2-ddd9eafdc0a3 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:04.946607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ef1cf-4a21-4e04-9952-ad7c895f7b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:04.947375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ef1cf-4a21-4e04-9952-ad7c895f7b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:04.947653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ef1cf-4a21-4e04-9952-ad7c895f7b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:04.947929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ef1cf-4a21-4e04-9952-ad7c895f7b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:04.948622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ef1cf-4a21-4e04-9952-ad7c895f7b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:04.950319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ef1cf-4a21-4e04-9952-ad7c895f7b93 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:04.961344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1092/2203] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:11:04.965653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc890-600e-4af3-a437-9816392de863 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:04.976513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc890-600e-4af3-a437-9816392de863 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:04.981391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d8e9-c6a1-412a-8a9a-5f64c8475c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:04.982085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d8e9-c6a1-412a-8a9a-5f64c8475c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:04.982371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d8e9-c6a1-412a-8a9a-5f64c8475c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:04.982715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d8e9-c6a1-412a-8a9a-5f64c8475c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:04.983507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d8e9-c6a1-412a-8a9a-5f64c8475c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:04.985215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d8e9-c6a1-412a-8a9a-5f64c8475c85 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:04.996686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1112/2204] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:11:05.000930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ef1cf-4a21-4e04-9952-ad7c895f7b93 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:05.010940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ef1cf-4a21-4e04-9952-ad7c895f7b93 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:05.015672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e56fb8-60aa-41f9-8eff-7f9c7efc54a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:05.016390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e56fb8-60aa-41f9-8eff-7f9c7efc54a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.016673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e56fb8-60aa-41f9-8eff-7f9c7efc54a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.016980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e56fb8-60aa-41f9-8eff-7f9c7efc54a0 admin admin] PATH_INFO: `/v3/projects/d139a991d862496c8cd2a55b56bee0bb/users/1c704b9317ff40f1a75220494b6d525e/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.034802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e56fb8-60aa-41f9-8eff-7f9c7efc54a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d139a991d862496c8cd2a55b56bee0bb, user_id=1c704b9317ff40f1a75220494b6d525e, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:05.038217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e56fb8-60aa-41f9-8eff-7f9c7efc54a0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:05.109667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1093/2205] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:11:04 2022] PUT /identity/v3/projects/d139a991d862496c8cd2a55b56bee0bb/users/1c704b9317ff40f1a75220494b6d525e/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:05.123143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d24f6-6ab4-4e0b-8869-8a75172e1960 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.123599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d24f6-6ab4-4e0b-8869-8a75172e1960 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.124465 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d24f6-6ab4-4e0b-8869-8a75172e1960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.150622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71ebf4-097e-43e2-a5c2-f02c5231763e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.150943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71ebf4-097e-43e2-a5c2-f02c5231763e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.151225 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71ebf4-097e-43e2-a5c2-f02c5231763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.157569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d45d24f6-6ab4-4e0b-8869-8a75172e1960 None None] MFA Rules not processed for user `1c704b9317ff40f1a75220494b6d525e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:05.158785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d45d24f6-6ab4-4e0b-8869-8a75172e1960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:05.190228 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-0c71ebf4-097e-43e2-a5c2-f02c5231763e None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:05.191454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0c71ebf4-097e-43e2-a5c2-f02c5231763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:05.211873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:05.243115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1113/2206] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:05.247601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d24f6-6ab4-4e0b-8869-8a75172e1960 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:05.260577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1094/2207] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 28 18:11:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:11:05.266105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:05.273906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71ebf4-097e-43e2-a5c2-f02c5231763e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:05.275333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0c71ebf4-097e-43e2-a5c2-f02c5231763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:05.313672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d24f6-6ab4-4e0b-8869-8a75172e1960 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:05.318430 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6d476-77ee-461d-bca9-4887ab0d22cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:05.319096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6d476-77ee-461d-bca9-4887ab0d22cb admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.319382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6d476-77ee-461d-bca9-4887ab0d22cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.319658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6d476-77ee-461d-bca9-4887ab0d22cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.320349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6d476-77ee-461d-bca9-4887ab0d22cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:05.322372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6d476-77ee-461d-bca9-4887ab0d22cb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:05.362417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71ebf4-097e-43e2-a5c2-f02c5231763e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:05.368191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddbadf-73ac-44b2-919c-4f1b642b9a88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:05.369076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddbadf-73ac-44b2-919c-4f1b642b9a88 service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.369594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddbadf-73ac-44b2-919c-4f1b642b9a88 service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.369869 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddbadf-73ac-44b2-919c-4f1b642b9a88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.379550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddbadf-73ac-44b2-919c-4f1b642b9a88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:05.381221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddbadf-73ac-44b2-919c-4f1b642b9a88 service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:05.397207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1095/2208] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:11:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 18:11:05.446418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1114/2209] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:11:05 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:11:05.449035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddbadf-73ac-44b2-919c-4f1b642b9a88 service swift] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:05.461112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddbadf-73ac-44b2-919c-4f1b642b9a88 service swift] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:05.568639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feaf264-fc72-4794-a446-b772aec772cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:05.569360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaf264-fc72-4794-a446-b772aec772cb admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.569805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaf264-fc72-4794-a446-b772aec772cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.570217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaf264-fc72-4794-a446-b772aec772cb admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.570938 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feaf264-fc72-4794-a446-b772aec772cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:05.572896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feaf264-fc72-4794-a446-b772aec772cb admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:05.700028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1096/2210] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:11:05 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:11:05.704148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6d476-77ee-461d-bca9-4887ab0d22cb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:05.715163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6d476-77ee-461d-bca9-4887ab0d22cb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:05.719701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46e1a5-1d36-4539-9e94-a486a068a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:05.720317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e1a5-1d36-4539-9e94-a486a068a044 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.720598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e1a5-1d36-4539-9e94-a486a068a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.722923 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e1a5-1d36-4539-9e94-a486a068a044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.722923 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46e1a5-1d36-4539-9e94-a486a068a044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:05.723748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46e1a5-1d36-4539-9e94-a486a068a044 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:05.734129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1115/2211] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:11:05.738281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feaf264-fc72-4794-a446-b772aec772cb admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:05.748873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feaf264-fc72-4794-a446-b772aec772cb admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:05.753843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94843532-8f26-42a6-bf96-8e815d3cfb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:05.754506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94843532-8f26-42a6-bf96-8e815d3cfb78 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.754856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94843532-8f26-42a6-bf96-8e815d3cfb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.755272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94843532-8f26-42a6-bf96-8e815d3cfb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.757077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94843532-8f26-42a6-bf96-8e815d3cfb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:05.758738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94843532-8f26-42a6-bf96-8e815d3cfb78 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:05.771686 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1097/2212] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:11:05.775586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46e1a5-1d36-4539-9e94-a486a068a044 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:05.786893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46e1a5-1d36-4539-9e94-a486a068a044 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:05.791937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa7729-a7e0-4827-81ae-c13fc0157ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:05.792673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa7729-a7e0-4827-81ae-c13fc0157ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.793073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa7729-a7e0-4827-81ae-c13fc0157ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.793408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa7729-a7e0-4827-81ae-c13fc0157ddb admin admin] PATH_INFO: `/v3/projects/81ab087e440a4188b7c222888acb40fb/users/ffec68b3745842afb84773b557cddc6f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.808338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa7729-a7e0-4827-81ae-c13fc0157ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ab087e440a4188b7c222888acb40fb, user_id=ffec68b3745842afb84773b557cddc6f, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:05.811015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa7729-a7e0-4827-81ae-c13fc0157ddb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:05.906039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1116/2213] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:11:05 2022] PUT /identity/v3/projects/81ab087e440a4188b7c222888acb40fb/users/ffec68b3745842afb84773b557cddc6f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:05.918533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b4a7-b667-4c01-8838-a1f70c334f53 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:05.918533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b4a7-b667-4c01-8838-a1f70c334f53 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:05.918758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b4a7-b667-4c01-8838-a1f70c334f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:05.947082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-93c7b4a7-b667-4c01-8838-a1f70c334f53 None None] MFA Rules not processed for user `ffec68b3745842afb84773b557cddc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:05.948275 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-93c7b4a7-b667-4c01-8838-a1f70c334f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:05.970543 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:06.016254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1098/2214] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:06.021770 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa7729-a7e0-4827-81ae-c13fc0157ddb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:06.101544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa7729-a7e0-4827-81ae-c13fc0157ddb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:06.106250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7caeb-c6c0-43aa-b90f-b283c2469bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:06.106922 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7caeb-c6c0-43aa-b90f-b283c2469bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:06.107246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7caeb-c6c0-43aa-b90f-b283c2469bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:06.107522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7caeb-c6c0-43aa-b90f-b283c2469bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:06.108306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7caeb-c6c0-43aa-b90f-b283c2469bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:06.110308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7caeb-c6c0-43aa-b90f-b283c2469bf0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:06.240199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1117/2215] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:11:06 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:11:06.244572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b4a7-b667-4c01-8838-a1f70c334f53 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:06.256551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b4a7-b667-4c01-8838-a1f70c334f53 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:06.320026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5518-1993-4dcc-a6c5-0a8a616c9a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:06.320648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5518-1993-4dcc-a6c5-0a8a616c9a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:06.320943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5518-1993-4dcc-a6c5-0a8a616c9a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:06.321216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5518-1993-4dcc-a6c5-0a8a616c9a9f admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:06.321889 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5518-1993-4dcc-a6c5-0a8a616c9a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:06.323829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5518-1993-4dcc-a6c5-0a8a616c9a9f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:06.505900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1099/2216] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:11:06 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:11:06.507411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7caeb-c6c0-43aa-b90f-b283c2469bf0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:06.520412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7caeb-c6c0-43aa-b90f-b283c2469bf0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:06.526082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37f8e5-b3c1-432d-ab8b-ad95d7b0ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:06.529731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37f8e5-b3c1-432d-ab8b-ad95d7b0ff76 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:06.529731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37f8e5-b3c1-432d-ab8b-ad95d7b0ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:06.529731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37f8e5-b3c1-432d-ab8b-ad95d7b0ff76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:06.529731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37f8e5-b3c1-432d-ab8b-ad95d7b0ff76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:06.530271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37f8e5-b3c1-432d-ab8b-ad95d7b0ff76 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:06.548012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1118/2217] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:11:06.552214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5518-1993-4dcc-a6c5-0a8a616c9a9f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:06.564578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5518-1993-4dcc-a6c5-0a8a616c9a9f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:06.569478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4195ecd-241f-4d01-bfd8-eac034847211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:06.570147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195ecd-241f-4d01-bfd8-eac034847211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:06.570425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195ecd-241f-4d01-bfd8-eac034847211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:06.570699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195ecd-241f-4d01-bfd8-eac034847211 admin admin] PATH_INFO: `/v3/projects/576b56ed3d614ffdaa7c24b1b02b47fa/users/4631b96ca0c54ff2bd445e63459a0eef/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:06.589607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195ecd-241f-4d01-bfd8-eac034847211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576b56ed3d614ffdaa7c24b1b02b47fa, user_id=4631b96ca0c54ff2bd445e63459a0eef, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:06.593112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195ecd-241f-4d01-bfd8-eac034847211 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:06.719415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1100/2218] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:11:06 2022] PUT /identity/v3/projects/576b56ed3d614ffdaa7c24b1b02b47fa/users/4631b96ca0c54ff2bd445e63459a0eef/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:06.724018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37f8e5-b3c1-432d-ab8b-ad95d7b0ff76 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:06.737395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37f8e5-b3c1-432d-ab8b-ad95d7b0ff76 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:06.779120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:06.796171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a05f6-1934-4c25-af7c-c6d201a5568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:06.796820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a05f6-1934-4c25-af7c-c6d201a5568b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:06.797133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a05f6-1934-4c25-af7c-c6d201a5568b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:06.797405 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a05f6-1934-4c25-af7c-c6d201a5568b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:06.798152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a05f6-1934-4c25-af7c-c6d201a5568b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:06.799712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a05f6-1934-4c25-af7c-c6d201a5568b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:06.809464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1119/2219] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:11:06.813671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4195ecd-241f-4d01-bfd8-eac034847211 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:06.824305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4195ecd-241f-4d01-bfd8-eac034847211 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:06.833390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875acd9-442b-44c1-a7d6-7b6a6aa33f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:06.837355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875acd9-442b-44c1-a7d6-7b6a6aa33f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:06.837355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875acd9-442b-44c1-a7d6-7b6a6aa33f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:06.837355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875acd9-442b-44c1-a7d6-7b6a6aa33f47 admin admin] PATH_INFO: `/v3/projects/576b56ed3d614ffdaa7c24b1b02b47fa/users/4631b96ca0c54ff2bd445e63459a0eef/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:06.837355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875acd9-442b-44c1-a7d6-7b6a6aa33f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576b56ed3d614ffdaa7c24b1b02b47fa, user_id=4631b96ca0c54ff2bd445e63459a0eef, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:06.839806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875acd9-442b-44c1-a7d6-7b6a6aa33f47 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:06.851797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1101/2220] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:11:06 2022] PUT /identity/v3/projects/576b56ed3d614ffdaa7c24b1b02b47fa/users/4631b96ca0c54ff2bd445e63459a0eef/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:06.921794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f57e6-6fc4-4409-8f18-6a181f31b48b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:06.922085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f57e6-6fc4-4409-8f18-6a181f31b48b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:06.922368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f57e6-6fc4-4409-8f18-6a181f31b48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:06.971804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a66f57e6-6fc4-4409-8f18-6a181f31b48b None None] MFA Rules not processed for user `4631b96ca0c54ff2bd445e63459a0eef`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:06.973277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a66f57e6-6fc4-4409-8f18-6a181f31b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:07.046660 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1120/2221] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:07.065031 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327da3-076f-4848-819b-5175df396c7d None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.065343 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327da3-076f-4848-819b-5175df396c7d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.065644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327da3-076f-4848-819b-5175df396c7d None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.067574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1102/2222] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:11:07.073503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c60ab-7122-4bb0-b7ff-08d828adbe1d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.073799 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c60ab-7122-4bb0-b7ff-08d828adbe1d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.074080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c60ab-7122-4bb0-b7ff-08d828adbe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.097025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-724c60ab-7122-4bb0-b7ff-08d828adbe1d None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:07.099108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-724c60ab-7122-4bb0-b7ff-08d828adbe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:07.185515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1121/2223] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:11:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:07.195000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327da3-076f-4848-819b-5175df396c7d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:07.204278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b3327da3-076f-4848-819b-5175df396c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:07.204379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c60ab-7122-4bb0-b7ff-08d828adbe1d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:07.204846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-724c60ab-7122-4bb0-b7ff-08d828adbe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:07.295742 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c60ab-7122-4bb0-b7ff-08d828adbe1d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:07.298441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327da3-076f-4848-819b-5175df396c7d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:07.299604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1f35d-66c2-4332-8d83-55272159531c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18138af1ea504faca84b0cc2034ddd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:07.300310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f35d-66c2-4332-8d83-55272159531c service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.300620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f35d-66c2-4332-8d83-55272159531c service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.301530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f35d-66c2-4332-8d83-55272159531c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.303150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8160d-03de-4315-af67-1290b031b692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:07.303957 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8160d-03de-4315-af67-1290b031b692 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.304429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8160d-03de-4315-af67-1290b031b692 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.304600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8160d-03de-4315-af67-1290b031b692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.313402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1f35d-66c2-4332-8d83-55272159531c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:07.314806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1f35d-66c2-4332-8d83-55272159531c service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:07.320267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:07.326793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1122/2224] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:11:07.337145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:07.370316 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8160d-03de-4315-af67-1290b031b692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:07.375507 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8160d-03de-4315-af67-1290b031b692 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:07.381096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1103/2225] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:07.563195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdc90-869d-4266-874e-cfd16d7cbf73 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.563829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdc90-869d-4266-874e-cfd16d7cbf73 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.563829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdc90-869d-4266-874e-cfd16d7cbf73 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.565168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1123/2226] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:11:07.570203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f8a45-4d1d-48fa-80c2-5f9f16af9d05 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.573026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f8a45-4d1d-48fa-80c2-5f9f16af9d05 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.573026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f8a45-4d1d-48fa-80c2-5f9f16af9d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.590939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c52f8a45-4d1d-48fa-80c2-5f9f16af9d05 None None] MFA Rules not processed for user `0116171a83f5444d91ce0ea2439a9bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:07.592219 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c52f8a45-4d1d-48fa-80c2-5f9f16af9d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:07.642967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1104/2227] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:11:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:11:07.655386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdc90-869d-4266-874e-cfd16d7cbf73 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:07.657113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2ddbdc90-869d-4266-874e-cfd16d7cbf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:07.670277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdc90-869d-4266-874e-cfd16d7cbf73 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:07.673950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12ba5b-fe25-4918-a343-e078b39f5099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:07.674556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ba5b-fe25-4918-a343-e078b39f5099 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.674840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ba5b-fe25-4918-a343-e078b39f5099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.675112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ba5b-fe25-4918-a343-e078b39f5099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.682204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12ba5b-fe25-4918-a343-e078b39f5099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:07.683743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12ba5b-fe25-4918-a343-e078b39f5099 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:07.699568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1124/2228] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:07.775626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9cccf-c6f4-4dc1-9336-d5907afb34bb None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.775940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9cccf-c6f4-4dc1-9336-d5907afb34bb None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.776218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9cccf-c6f4-4dc1-9336-d5907afb34bb None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.778033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1105/2229] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:11:07.783633 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190c3a-14dd-4815-b793-beaad4bda20b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.783968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190c3a-14dd-4815-b793-beaad4bda20b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.784195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4190c3a-14dd-4815-b793-beaad4bda20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.803925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d4190c3a-14dd-4815-b793-beaad4bda20b None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:07.805400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4190c3a-14dd-4815-b793-beaad4bda20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:07.817563 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1125/2230] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:11:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:11:07.830538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9cccf-c6f4-4dc1-9336-d5907afb34bb None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:07.843060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9cccf-c6f4-4dc1-9336-d5907afb34bb None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:07.847224 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520eaee-ed5a-4662-9623-8168ce0d4484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:07.847911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520eaee-ed5a-4662-9623-8168ce0d4484 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:07.848452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520eaee-ed5a-4662-9623-8168ce0d4484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:07.848797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520eaee-ed5a-4662-9623-8168ce0d4484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:07.865714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520eaee-ed5a-4662-9623-8168ce0d4484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:07.867452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520eaee-ed5a-4662-9623-8168ce0d4484 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:07.880924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1106/2231] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:08.297155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190c3a-14dd-4815-b793-beaad4bda20b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:08.298688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d4190c3a-14dd-4815-b793-beaad4bda20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:08.439251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4190c3a-14dd-4815-b793-beaad4bda20b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:08.445804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:08.446509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:08.446789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:08.447116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] PATH_INFO: `/v3/users/9ba91b008b0f40bb9f243c4933b24a8e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:08.449621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba91b008b0f40bb9f243c4933b24a8e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:08.452525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:08.661661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba91b008b0f40bb9f243c4933b24a8e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:08.662727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba91b008b0f40bb9f243c4933b24a8e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:08.670825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba91b008b0f40bb9f243c4933b24a8e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:08.671738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba91b008b0f40bb9f243c4933b24a8e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:08.685671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba91b008b0f40bb9f243c4933b24a8e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:08.796400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1126/2232] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:11:08 2022] DELETE /identity/v3/users/9ba91b008b0f40bb9f243c4933b24a8e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:08.801199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc59686-824e-48c0-b3ca-ea993f98500d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:08.801789 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc59686-824e-48c0-b3ca-ea993f98500d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:08.802070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc59686-824e-48c0-b3ca-ea993f98500d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:08.821499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7dc59686-824e-48c0-b3ca-ea993f98500d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:08.822720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7dc59686-824e-48c0-b3ca-ea993f98500d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:08.892652 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1107/2233] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:08.903347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:08.904759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:08.966202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b25a0f-e35e-4569-8db0-65ae7b6d96a2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:08.969981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0e0cc-f821-46c0-9c34-a9911d9eee21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:08.970583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e0cc-f821-46c0-9c34-a9911d9eee21 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:08.970886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e0cc-f821-46c0-9c34-a9911d9eee21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:08.971157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e0cc-f821-46c0-9c34-a9911d9eee21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:08.981730 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0e0cc-f821-46c0-9c34-a9911d9eee21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:08.983161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0e0cc-f821-46c0-9c34-a9911d9eee21 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:08.988523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:08.993720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1127/2234] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:09.487111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc59686-824e-48c0-b3ca-ea993f98500d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:09.488057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7dc59686-824e-48c0-b3ca-ea993f98500d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:09.511805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0e0cc-f821-46c0-9c34-a9911d9eee21 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:09.513449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d1b0e0cc-f821-46c0-9c34-a9911d9eee21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:09.532277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0e0cc-f821-46c0-9c34-a9911d9eee21 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:09.538547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:09.539254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:09.539584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:09.540494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] PATH_INFO: `/v3/users/eb2b7be73e534e09a80c69d2f08f0cde` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:09.542428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2b7be73e534e09a80c69d2f08f0cde)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:09.543901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:09.600518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc59686-824e-48c0-b3ca-ea993f98500d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:09.606038 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:09.606664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:09.607000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:09.607281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:09.610785 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:09.633117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:09.682973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:09.684772 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:09.697793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1108/2235] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:09.862720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2b7be73e534e09a80c69d2f08f0cde'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:09.863788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2b7be73e534e09a80c69d2f08f0cde'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:09.871495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2b7be73e534e09a80c69d2f08f0cde'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:09.872820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2b7be73e534e09a80c69d2f08f0cde'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:09.895683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2b7be73e534e09a80c69d2f08f0cde'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:10.041332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:10.043602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:10.046841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1128/2236] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:11:09 2022] DELETE /identity/v3/users/eb2b7be73e534e09a80c69d2f08f0cde => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:11:10.063750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e832bcb-9c43-47b8-b56a-acc262e2c2e4 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:10.140278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:10.141228 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:10.141667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:10.142206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] PATH_INFO: `/v3/projects/81e0a5bfe13747428f08211015b716a3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:10.143661 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e0a5bfe13747428f08211015b716a3)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:10.146435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:10.309537 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e0a5bfe13747428f08211015b716a3', 'request_id': 'req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:10.315725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e0a5bfe13747428f08211015b716a3', 'request_id': 'req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:10.426018 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e0a5bfe13747428f08211015b716a3', 'request_id': 'req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:10.435483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:10.437040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:10.445682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] The token cache is being invalidate because project 81e0a5bfe13747428f08211015b716a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:11:10.446263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:10.446852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d0f1b0b-d86f-479d-b381-aee341b0e0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:10.450027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1109/2237] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:11:10 2022] DELETE /identity/v3/projects/81e0a5bfe13747428f08211015b716a3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:10.479095 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade80a8b-1b13-4c95-989a-b8c35de996ea admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:10.661839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:10.663401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:10.663696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:10.663982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] PATH_INFO: `/v3/projects/944b4c28627748b1aaa1a8fd2d2df979` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:10.665404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944b4c28627748b1aaa1a8fd2d2df979)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:10.668131 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:10.876671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944b4c28627748b1aaa1a8fd2d2df979', 'request_id': 'req-100158fc-da7d-4a22-8222-aba01d5249c3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:11.096640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944b4c28627748b1aaa1a8fd2d2df979', 'request_id': 'req-100158fc-da7d-4a22-8222-aba01d5249c3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:11.105408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944b4c28627748b1aaa1a8fd2d2df979', 'request_id': 'req-100158fc-da7d-4a22-8222-aba01d5249c3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:11.119327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] The token cache is being invalidate because project 944b4c28627748b1aaa1a8fd2d2df979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:11:11.120387 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:11.121088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-100158fc-da7d-4a22-8222-aba01d5249c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:11.124729 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1129/2238] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:11:10 2022] DELETE /identity/v3/projects/944b4c28627748b1aaa1a8fd2d2df979 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:11:11.136046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ff645-8dc1-4dae-8219-a54248d51438 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.136573 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ff645-8dc1-4dae-8219-a54248d51438 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.136675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ff645-8dc1-4dae-8219-a54248d51438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.156634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b86ff645-8dc1-4dae-8219-a54248d51438 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:11.161347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b86ff645-8dc1-4dae-8219-a54248d51438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:11.217498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:11.231563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1110/2239] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:11.240008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a052b-78b3-4bff-8d6d-0786daf6b7ed None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.240320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a052b-78b3-4bff-8d6d-0786daf6b7ed None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.240603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a052b-78b3-4bff-8d6d-0786daf6b7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.248479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:11.261643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-494a052b-78b3-4bff-8d6d-0786daf6b7ed None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:11.262878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-494a052b-78b3-4bff-8d6d-0786daf6b7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:11.270615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1130/2240] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:11.275703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ff645-8dc1-4dae-8219-a54248d51438 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:11.285512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ff645-8dc1-4dae-8219-a54248d51438 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:11.290354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b0d2b-7a8d-4dc1-9d8d-59e32db6c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:11.290993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0d2b-7a8d-4dc1-9d8d-59e32db6c86a admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.291289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0d2b-7a8d-4dc1-9d8d-59e32db6c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.291561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b0d2b-7a8d-4dc1-9d8d-59e32db6c86a admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.292258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b0d2b-7a8d-4dc1-9d8d-59e32db6c86a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:11:11.292566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b0d2b-7a8d-4dc1-9d8d-59e32db6c86a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:11.294277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b0d2b-7a8d-4dc1-9d8d-59e32db6c86a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:11.307344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1111/2241] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:11:11.311957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a052b-78b3-4bff-8d6d-0786daf6b7ed None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:11.321679 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a052b-78b3-4bff-8d6d-0786daf6b7ed None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:11.326335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989bbcc-4c36-422e-aa22-000d23da0870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:11.326936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989bbcc-4c36-422e-aa22-000d23da0870 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.327221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989bbcc-4c36-422e-aa22-000d23da0870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.327496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989bbcc-4c36-422e-aa22-000d23da0870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.328162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989bbcc-4c36-422e-aa22-000d23da0870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:11.330099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989bbcc-4c36-422e-aa22-000d23da0870 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:11.435205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1131/2242] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:11:11 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:11:11.439491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b0d2b-7a8d-4dc1-9d8d-59e32db6c86a admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:11.449495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b0d2b-7a8d-4dc1-9d8d-59e32db6c86a admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:11.506289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de5cf-cc35-42a9-b4c2-01b9831eef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:11.506896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de5cf-cc35-42a9-b4c2-01b9831eef65 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.507172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de5cf-cc35-42a9-b4c2-01b9831eef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.507442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de5cf-cc35-42a9-b4c2-01b9831eef65 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.508100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de5cf-cc35-42a9-b4c2-01b9831eef65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:11.510091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de5cf-cc35-42a9-b4c2-01b9831eef65 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:11.666606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1112/2243] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:11:11 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:11:11.670602 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989bbcc-4c36-422e-aa22-000d23da0870 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:11.681913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989bbcc-4c36-422e-aa22-000d23da0870 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:11.686793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e394025-1038-4890-bd64-ca0913155309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:11.687655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e394025-1038-4890-bd64-ca0913155309 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.688177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e394025-1038-4890-bd64-ca0913155309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.688526 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e394025-1038-4890-bd64-ca0913155309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.689360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e394025-1038-4890-bd64-ca0913155309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:11.691149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e394025-1038-4890-bd64-ca0913155309 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:11.705238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1132/2244] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:11:11.706539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de5cf-cc35-42a9-b4c2-01b9831eef65 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:11.717670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de5cf-cc35-42a9-b4c2-01b9831eef65 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:11.722410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9ffc0-55ce-469a-b452-a5c23614c8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:11.723066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9ffc0-55ce-469a-b452-a5c23614c8db admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.723445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9ffc0-55ce-469a-b452-a5c23614c8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.723587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9ffc0-55ce-469a-b452-a5c23614c8db admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.724388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9ffc0-55ce-469a-b452-a5c23614c8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:11.726132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9ffc0-55ce-469a-b452-a5c23614c8db admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:11.734644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e394025-1038-4890-bd64-ca0913155309 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:11.736653 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6e394025-1038-4890-bd64-ca0913155309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:11.740604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1113/2245] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:11:11.749325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9ffc0-55ce-469a-b452-a5c23614c8db admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:11.761282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9ffc0-55ce-469a-b452-a5c23614c8db admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:11.766414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7da6-8d54-4e50-93f1-67ea4e7f89a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:11.767079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7da6-8d54-4e50-93f1-67ea4e7f89a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.767359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7da6-8d54-4e50-93f1-67ea4e7f89a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.767636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7da6-8d54-4e50-93f1-67ea4e7f89a4 admin admin] PATH_INFO: `/v3/projects/d7475c64d7fd41139d021ab27215b194/users/5c9bcec78f08499dba7b64b4d21ceddd/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.784042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e7da6-8d54-4e50-93f1-67ea4e7f89a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7475c64d7fd41139d021ab27215b194, user_id=5c9bcec78f08499dba7b64b4d21ceddd, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:11.787690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e7da6-8d54-4e50-93f1-67ea4e7f89a4 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:11.796051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e394025-1038-4890-bd64-ca0913155309 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:11.799747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:11.800367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.800658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.801033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.802856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:11.865295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1114/2246] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:11:11 2022] PUT /identity/v3/projects/d7475c64d7fd41139d021ab27215b194/users/5c9bcec78f08499dba7b64b4d21ceddd/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:11.868978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:11.870433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97562fee-858f-40fe-a68e-1a67b3f11928 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:11.870433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97562fee-858f-40fe-a68e-1a67b3f11928 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:11.870648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:11.870941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97562fee-858f-40fe-a68e-1a67b3f11928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:11.882445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1133/2247] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:11:11.890536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-97562fee-858f-40fe-a68e-1a67b3f11928 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:11.891816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-97562fee-858f-40fe-a68e-1a67b3f11928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:11.956817 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1115/2248] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:11.967981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:11.969507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:12.045549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf40ddf-d749-4e8f-84bd-6a8855f00396 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:12.097483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324170c-c694-4460-99d9-5626767c30a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:12.098667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324170c-c694-4460-99d9-5626767c30a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:12.099101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324170c-c694-4460-99d9-5626767c30a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:12.099386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324170c-c694-4460-99d9-5626767c30a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:12.109861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324170c-c694-4460-99d9-5626767c30a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:12.111394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324170c-c694-4460-99d9-5626767c30a5 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:12.122795 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1134/2249] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:12.294817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:12.925176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5799a-dab4-4282-b408-4ce117dd2b61 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:12.925656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5799a-dab4-4282-b408-4ce117dd2b61 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:12.925759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5799a-dab4-4282-b408-4ce117dd2b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:12.945761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-fbd5799a-dab4-4282-b408-4ce117dd2b61 None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:12.947175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fbd5799a-dab4-4282-b408-4ce117dd2b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:12.977022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:13.001923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1116/2250] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:11:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:13.014246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324170c-c694-4460-99d9-5626767c30a5 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:13.015680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6324170c-c694-4460-99d9-5626767c30a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:13.089794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324170c-c694-4460-99d9-5626767c30a5 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:13.094926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bd5be-9e63-4919-a1a4-423db031a3ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:13.095569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bd5be-9e63-4919-a1a4-423db031a3ca service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:13.095848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bd5be-9e63-4919-a1a4-423db031a3ca service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:13.096117 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bd5be-9e63-4919-a1a4-423db031a3ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:13.104911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bd5be-9e63-4919-a1a4-423db031a3ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:13.108372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bd5be-9e63-4919-a1a4-423db031a3ca service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:13.115241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1135/2251] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:11:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:11:13.839569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43820e3b-aa83-4d22-a5ab-d19ac8862df7 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:13.841209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43820e3b-aa83-4d22-a5ab-d19ac8862df7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:13.842743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43820e3b-aa83-4d22-a5ab-d19ac8862df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:13.894176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-43820e3b-aa83-4d22-a5ab-d19ac8862df7 None None] MFA Rules not processed for user `5c9bcec78f08499dba7b64b4d21ceddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:13.896141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-43820e3b-aa83-4d22-a5ab-d19ac8862df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:13.986015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1117/2252] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:13.997914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bd5be-9e63-4919-a1a4-423db031a3ca service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:13.999597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cb2bd5be-9e63-4919-a1a4-423db031a3ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:14.100399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bd5be-9e63-4919-a1a4-423db031a3ca service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:14.107312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cc37a-c6dd-443b-a4c2-fbc56698f66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:14.108152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cc37a-c6dd-443b-a4c2-fbc56698f66a service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:14.108530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cc37a-c6dd-443b-a4c2-fbc56698f66a service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:14.108932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cc37a-c6dd-443b-a4c2-fbc56698f66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:14.137968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cc37a-c6dd-443b-a4c2-fbc56698f66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:14.139712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cc37a-c6dd-443b-a4c2-fbc56698f66a service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:14.152555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1136/2253] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:16.094980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a47d2-413c-429d-9f47-f5910756ce15 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:16.095517 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a47d2-413c-429d-9f47-f5910756ce15 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:16.095610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a47d2-413c-429d-9f47-f5910756ce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:16.118758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2a9a47d2-413c-429d-9f47-f5910756ce15 None None] MFA Rules not processed for user `5c9bcec78f08499dba7b64b4d21ceddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:16.119983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2a9a47d2-413c-429d-9f47-f5910756ce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:16.142260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1118/2254] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:18.002977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cc37a-c6dd-443b-a4c2-fbc56698f66a service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:18.004699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-359cc37a-c6dd-443b-a4c2-fbc56698f66a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:18.019148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cc37a-c6dd-443b-a4c2-fbc56698f66a service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:18.026931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:18.026931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:18.026931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:18.026931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] PATH_INFO: `/v3/users/1c704b9317ff40f1a75220494b6d525e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:18.027499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c704b9317ff40f1a75220494b6d525e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:18.029536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:18.594949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c704b9317ff40f1a75220494b6d525e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:18.595679 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c704b9317ff40f1a75220494b6d525e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:18.603162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c704b9317ff40f1a75220494b6d525e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:18.603863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c704b9317ff40f1a75220494b6d525e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:18.606219 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:18.618467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c704b9317ff40f1a75220494b6d525e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:18.779740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1137/2255] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:11:18 2022] DELETE /identity/v3/users/1c704b9317ff40f1a75220494b6d525e => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:18.788892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7db42-2fb4-4672-85e5-622eefecd5ea None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:18.788892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7db42-2fb4-4672-85e5-622eefecd5ea None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:18.788892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7db42-2fb4-4672-85e5-622eefecd5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:18.807246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-62a7db42-2fb4-4672-85e5-622eefecd5ea None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:18.808824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-62a7db42-2fb4-4672-85e5-622eefecd5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:18.877695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1119/2256] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:18.890351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:18.892505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:18.972151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f79fe-fbaa-44ec-b5c2-7dc0ebb50458 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:18.979105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044777b5-0bef-4bff-8de5-654a0883a6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:18.980202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044777b5-0bef-4bff-8de5-654a0883a6dc service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:18.980697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044777b5-0bef-4bff-8de5-654a0883a6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:18.981107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044777b5-0bef-4bff-8de5-654a0883a6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:18.992924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044777b5-0bef-4bff-8de5-654a0883a6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:18.994847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044777b5-0bef-4bff-8de5-654a0883a6dc service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:19.010357 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1138/2257] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:20.429801 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7db42-2fb4-4672-85e5-622eefecd5ea None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:20.451696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-62a7db42-2fb4-4672-85e5-622eefecd5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:20.451696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7db42-2fb4-4672-85e5-622eefecd5ea None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:20.451696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:20.452696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:20.452696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:20.452696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] PATH_INFO: `/v3/projects/d139a991d862496c8cd2a55b56bee0bb` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:20.463759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d139a991d862496c8cd2a55b56bee0bb)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:20.466327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:20.661814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd139a991d862496c8cd2a55b56bee0bb', 'request_id': 'req-41780882-f26a-4910-a30a-f2c31d3f7187'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:20.667105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:20.668470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd139a991d862496c8cd2a55b56bee0bb', 'request_id': 'req-41780882-f26a-4910-a30a-f2c31d3f7187'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:20.781133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd139a991d862496c8cd2a55b56bee0bb', 'request_id': 'req-41780882-f26a-4910-a30a-f2c31d3f7187'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:20.793298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] The token cache is being invalidate because project d139a991d862496c8cd2a55b56bee0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:11:20.793587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:20.794245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:20.795762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1120/2258] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:11:20 2022] DELETE /identity/v3/projects/d139a991d862496c8cd2a55b56bee0bb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:20.799823 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044777b5-0bef-4bff-8de5-654a0883a6dc service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:20.810142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044777b5-0bef-4bff-8de5-654a0883a6dc service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:20.869435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:20.870088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:20.870372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:20.870652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] PATH_INFO: `/v3/users/ffec68b3745842afb84773b557cddc6f` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:20.871858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffec68b3745842afb84773b557cddc6f)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:20.873820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:21.454963 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffec68b3745842afb84773b557cddc6f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:21.456082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffec68b3745842afb84773b557cddc6f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:21.466043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffec68b3745842afb84773b557cddc6f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:21.466777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffec68b3745842afb84773b557cddc6f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:21.491683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffec68b3745842afb84773b557cddc6f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:21.668608 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:21.673856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1139/2259] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:11:20 2022] DELETE /identity/v3/users/ffec68b3745842afb84773b557cddc6f => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:22.154111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:22.155766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:22.198173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41780882-f26a-4910-a30a-f2c31d3f7187 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:22.276820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:22.277462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:22.277741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:22.278070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] PATH_INFO: `/v3/projects/81ab087e440a4188b7c222888acb40fb` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:22.279386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ab087e440a4188b7c222888acb40fb)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:22.281432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:22.396948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ab087e440a4188b7c222888acb40fb', 'request_id': 'req-ccc1ef6c-7d13-445c-998f-573d857432f9'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:22.403173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ab087e440a4188b7c222888acb40fb', 'request_id': 'req-ccc1ef6c-7d13-445c-998f-573d857432f9'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:22.493397 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ab087e440a4188b7c222888acb40fb', 'request_id': 'req-ccc1ef6c-7d13-445c-998f-573d857432f9'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:22.510001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] The token cache is being invalidate because project 81ab087e440a4188b7c222888acb40fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:11:22.510315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:22.510993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:22.512914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1121/2260] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:11:22 2022] DELETE /identity/v3/projects/81ab087e440a4188b7c222888acb40fb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:22.517690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:22.519641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:22.533087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45aed-3ad2-4956-8fcc-9aac4b05bc28 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:22.599938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:22.600491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:22.600760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:22.601065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] PATH_INFO: `/v3/users/4631b96ca0c54ff2bd445e63459a0eef` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:22.602244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4631b96ca0c54ff2bd445e63459a0eef)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:22.604265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:22.882853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4631b96ca0c54ff2bd445e63459a0eef'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:22.883535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4631b96ca0c54ff2bd445e63459a0eef'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:22.900824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4631b96ca0c54ff2bd445e63459a0eef'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:22.901618 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4631b96ca0c54ff2bd445e63459a0eef'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:22.915714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0315bf6e-c831-4516-b570-5365f94b1e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4631b96ca0c54ff2bd445e63459a0eef'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:23.005698 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1140/2261] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:11:22 2022] DELETE /identity/v3/users/4631b96ca0c54ff2bd445e63459a0eef => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:23.479904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:23.481397 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:23.496077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1ef6c-7d13-445c-998f-573d857432f9 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:23.559318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:23.559959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:23.560238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:23.560512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] PATH_INFO: `/v3/projects/576b56ed3d614ffdaa7c24b1b02b47fa` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:23.561730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576b56ed3d614ffdaa7c24b1b02b47fa)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:23.563646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:23.581085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:23.721930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576b56ed3d614ffdaa7c24b1b02b47fa', 'request_id': 'req-c5c697cc-d134-4104-ba52-1910c5ed97d7'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:23.727521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576b56ed3d614ffdaa7c24b1b02b47fa', 'request_id': 'req-c5c697cc-d134-4104-ba52-1910c5ed97d7'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:23.841192 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576b56ed3d614ffdaa7c24b1b02b47fa', 'request_id': 'req-c5c697cc-d134-4104-ba52-1910c5ed97d7'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:23.853029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] The token cache is being invalidate because project 576b56ed3d614ffdaa7c24b1b02b47fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:11:23.853327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:23.853957 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c5c697cc-d134-4104-ba52-1910c5ed97d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:11:23.855500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1122/2262] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:11:23 2022] DELETE /identity/v3/projects/576b56ed3d614ffdaa7c24b1b02b47fa => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:23.860719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a4bd5-fd8b-42f8-848a-a38311d91286 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:23.868834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a4bd5-fd8b-42f8-848a-a38311d91286 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:23.868834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a4bd5-fd8b-42f8-848a-a38311d91286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:23.884051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-191a4bd5-fd8b-42f8-848a-a38311d91286 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:23.885446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-191a4bd5-fd8b-42f8-848a-a38311d91286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:23.947260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1141/2263] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:11:23.955681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f17a8b-1301-44f4-bab2-03be56ade703 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:23.956147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f17a8b-1301-44f4-bab2-03be56ade703 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:23.956431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f17a8b-1301-44f4-bab2-03be56ade703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:23.978429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f5f17a8b-1301-44f4-bab2-03be56ade703 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:23.979254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f5f17a8b-1301-44f4-bab2-03be56ade703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:23.989470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1123/2264] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:23.993921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a4bd5-fd8b-42f8-848a-a38311d91286 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:24.004577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a4bd5-fd8b-42f8-848a-a38311d91286 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:24.010038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289b1ea-7601-4880-ab8c-638069cc2d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:24.010667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289b1ea-7601-4880-ab8c-638069cc2d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:24.010947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289b1ea-7601-4880-ab8c-638069cc2d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:24.011226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289b1ea-7601-4880-ab8c-638069cc2d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:24.011930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289b1ea-7601-4880-ab8c-638069cc2d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:11:24.012235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289b1ea-7601-4880-ab8c-638069cc2d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:24.014087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289b1ea-7601-4880-ab8c-638069cc2d37 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:24.027565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1142/2265] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:11:24.031802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f17a8b-1301-44f4-bab2-03be56ade703 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:24.046780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f17a8b-1301-44f4-bab2-03be56ade703 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:24.051891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885168f-285e-4e11-bdfc-20e515d0b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:24.052526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885168f-285e-4e11-bdfc-20e515d0b22d admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:24.052861 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885168f-285e-4e11-bdfc-20e515d0b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:24.053160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885168f-285e-4e11-bdfc-20e515d0b22d admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:24.054499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885168f-285e-4e11-bdfc-20e515d0b22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:24.056775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885168f-285e-4e11-bdfc-20e515d0b22d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:24.152520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1124/2266] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:11:24 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:11:24.156829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289b1ea-7601-4880-ab8c-638069cc2d37 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:24.168336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:24.172547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289b1ea-7601-4880-ab8c-638069cc2d37 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:24.260927 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91e312-b2e8-451a-b420-d05b08f42d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:24.261658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91e312-b2e8-451a-b420-d05b08f42d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:24.262031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91e312-b2e8-451a-b420-d05b08f42d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:24.262376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91e312-b2e8-451a-b420-d05b08f42d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:24.263282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91e312-b2e8-451a-b420-d05b08f42d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:24.265971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91e312-b2e8-451a-b420-d05b08f42d00 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:24.386730 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1143/2267] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:11:24 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:11:24.390730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885168f-285e-4e11-bdfc-20e515d0b22d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:24.401961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885168f-285e-4e11-bdfc-20e515d0b22d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:24.406494 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517a348-8668-44c3-abed-675edf51dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:24.407095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517a348-8668-44c3-abed-675edf51dcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:24.407374 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517a348-8668-44c3-abed-675edf51dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:24.407646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517a348-8668-44c3-abed-675edf51dcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:24.408478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517a348-8668-44c3-abed-675edf51dcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:24.410111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517a348-8668-44c3-abed-675edf51dcbd admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:24.420143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1125/2268] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:11:24.424026 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91e312-b2e8-451a-b420-d05b08f42d00 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:24.433976 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91e312-b2e8-451a-b420-d05b08f42d00 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:24.438973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7d17d-016d-4c5a-a8f8-b1be465dfc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:24.439821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7d17d-016d-4c5a-a8f8-b1be465dfc8c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:24.440104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7d17d-016d-4c5a-a8f8-b1be465dfc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:24.440376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7d17d-016d-4c5a-a8f8-b1be465dfc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:24.441110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7d17d-016d-4c5a-a8f8-b1be465dfc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:24.443306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7d17d-016d-4c5a-a8f8-b1be465dfc8c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:24.454827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1144/2269] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:11:24.459567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517a348-8668-44c3-abed-675edf51dcbd admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:24.470245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517a348-8668-44c3-abed-675edf51dcbd admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:24.474860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd593bb9-d0c8-4759-95af-4646d16f2fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:24.475524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593bb9-d0c8-4759-95af-4646d16f2fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:24.475800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593bb9-d0c8-4759-95af-4646d16f2fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:24.476103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593bb9-d0c8-4759-95af-4646d16f2fa1 admin admin] PATH_INFO: `/v3/projects/208f9a2169764bacb536951f6a049229/users/b7f2bda7559e408183484833bf8935ca/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:24.491418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd593bb9-d0c8-4759-95af-4646d16f2fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208f9a2169764bacb536951f6a049229, user_id=b7f2bda7559e408183484833bf8935ca, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:24.494103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd593bb9-d0c8-4759-95af-4646d16f2fa1 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:24.568560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1126/2270] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:11:24 2022] PUT /identity/v3/projects/208f9a2169764bacb536951f6a049229/users/b7f2bda7559e408183484833bf8935ca/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:11:24.573868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac841da0-6c05-4fbf-9e06-9366f3cb0a13 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:24.574160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac841da0-6c05-4fbf-9e06-9366f3cb0a13 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:24.574440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac841da0-6c05-4fbf-9e06-9366f3cb0a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:24.593389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ac841da0-6c05-4fbf-9e06-9366f3cb0a13 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:24.594584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ac841da0-6c05-4fbf-9e06-9366f3cb0a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:24.651991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1145/2271] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:24.662141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd593bb9-d0c8-4759-95af-4646d16f2fa1 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:24.663899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fd593bb9-d0c8-4759-95af-4646d16f2fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:24.721001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd593bb9-d0c8-4759-95af-4646d16f2fa1 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:24.724737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be74a6f-87a7-48c6-bf91-a51ab81adde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:24.725372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be74a6f-87a7-48c6-bf91-a51ab81adde4 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:24.725658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be74a6f-87a7-48c6-bf91-a51ab81adde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:24.725961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be74a6f-87a7-48c6-bf91-a51ab81adde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:24.734857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be74a6f-87a7-48c6-bf91-a51ab81adde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:24.736280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be74a6f-87a7-48c6-bf91-a51ab81adde4 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:24.746248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1127/2272] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:11:31.583800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e7e67-7ffb-417a-83d3-944c171177a0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:31.584374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e7e67-7ffb-417a-83d3-944c171177a0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:31.584374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e7e67-7ffb-417a-83d3-944c171177a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:31.620916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-715e7e67-7ffb-417a-83d3-944c171177a0 None None] MFA Rules not processed for user `b7f2bda7559e408183484833bf8935ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:31.622484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-715e7e67-7ffb-417a-83d3-944c171177a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:31.707087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1146/2273] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:31.711751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be74a6f-87a7-48c6-bf91-a51ab81adde4 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:31.725024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be74a6f-87a7-48c6-bf91-a51ab81adde4 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:31.741726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd71505-8c9e-405d-b2c2-ff447e5d076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:31.742413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd71505-8c9e-405d-b2c2-ff447e5d076b admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:31.742704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd71505-8c9e-405d-b2c2-ff447e5d076b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:31.743053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd71505-8c9e-405d-b2c2-ff447e5d076b admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:31.743727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd71505-8c9e-405d-b2c2-ff447e5d076b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:31.745923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd71505-8c9e-405d-b2c2-ff447e5d076b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:31.878053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e7e67-7ffb-417a-83d3-944c171177a0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:31.880927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1128/2274] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:11:31 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:11:31.899135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e7e67-7ffb-417a-83d3-944c171177a0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:31.914571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:31.995780 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c70670-c23f-4967-a255-307f7017c133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:31.996631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c70670-c23f-4967-a255-307f7017c133 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:31.996969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c70670-c23f-4967-a255-307f7017c133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:31.997252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c70670-c23f-4967-a255-307f7017c133 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:31.997990 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c70670-c23f-4967-a255-307f7017c133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:32.000298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c70670-c23f-4967-a255-307f7017c133 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:32.115050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd71505-8c9e-405d-b2c2-ff447e5d076b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:32.116566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1147/2275] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:11:31 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:11:32.127046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd71505-8c9e-405d-b2c2-ff447e5d076b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:32.132681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7526c-deef-4186-94ea-24ea68d1c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:32.133561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7526c-deef-4186-94ea-24ea68d1c18b admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:32.134029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7526c-deef-4186-94ea-24ea68d1c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:32.134476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7526c-deef-4186-94ea-24ea68d1c18b admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:32.135385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7526c-deef-4186-94ea-24ea68d1c18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:32.137288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7526c-deef-4186-94ea-24ea68d1c18b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:32.159297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1129/2276] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:11:32.165123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c70670-c23f-4967-a255-307f7017c133 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:32.181846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c70670-c23f-4967-a255-307f7017c133 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:32.193075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b955-cb6b-44cc-8887-5e5fd72edd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:32.198538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b955-cb6b-44cc-8887-5e5fd72edd1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:32.199635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b955-cb6b-44cc-8887-5e5fd72edd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:32.200046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b955-cb6b-44cc-8887-5e5fd72edd1c admin admin] PATH_INFO: `/v3/projects/141e25f9fa7644cc966f75e005ed5ed1/users/69b002cc0f9942b7be08ad6b003284be/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:32.228131 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b955-cb6b-44cc-8887-5e5fd72edd1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=141e25f9fa7644cc966f75e005ed5ed1, user_id=69b002cc0f9942b7be08ad6b003284be, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:32.243043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b955-cb6b-44cc-8887-5e5fd72edd1c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:32.370639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1148/2277] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:11:32 2022] PUT /identity/v3/projects/141e25f9fa7644cc966f75e005ed5ed1/users/69b002cc0f9942b7be08ad6b003284be/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:32.373728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7526c-deef-4186-94ea-24ea68d1c18b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:32.384707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7526c-deef-4186-94ea-24ea68d1c18b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:32.395979 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:32.453229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055fe81-9c7c-49dc-94be-3c86cebe1de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:32.454065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055fe81-9c7c-49dc-94be-3c86cebe1de0 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:32.454448 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055fe81-9c7c-49dc-94be-3c86cebe1de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:32.454839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055fe81-9c7c-49dc-94be-3c86cebe1de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:32.455680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055fe81-9c7c-49dc-94be-3c86cebe1de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:32.457620 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055fe81-9c7c-49dc-94be-3c86cebe1de0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:32.470864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1130/2278] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:11:32.476385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b955-cb6b-44cc-8887-5e5fd72edd1c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:32.488052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b955-cb6b-44cc-8887-5e5fd72edd1c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:32.495862 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88a899-7385-4b5a-b095-2d083c5b7d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:32.497116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88a899-7385-4b5a-b095-2d083c5b7d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:32.497116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88a899-7385-4b5a-b095-2d083c5b7d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:32.497420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88a899-7385-4b5a-b095-2d083c5b7d79 admin admin] PATH_INFO: `/v3/projects/141e25f9fa7644cc966f75e005ed5ed1/users/69b002cc0f9942b7be08ad6b003284be/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:32.499500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88a899-7385-4b5a-b095-2d083c5b7d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141e25f9fa7644cc966f75e005ed5ed1, user_id=69b002cc0f9942b7be08ad6b003284be, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:32.502344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88a899-7385-4b5a-b095-2d083c5b7d79 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:32.518236 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1149/2279] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:11:32 2022] PUT /identity/v3/projects/141e25f9fa7644cc966f75e005ed5ed1/users/69b002cc0f9942b7be08ad6b003284be/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:11:36.114689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bfc06-ca40-493e-a340-ed54e12f12b5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:36.115201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bfc06-ca40-493e-a340-ed54e12f12b5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:36.115303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bfc06-ca40-493e-a340-ed54e12f12b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:36.148556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-295bfc06-ca40-493e-a340-ed54e12f12b5 None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:36.150437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-295bfc06-ca40-493e-a340-ed54e12f12b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:36.330300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1131/2280] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 28 18:11:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:36.359482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88a899-7385-4b5a-b095-2d083c5b7d79 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:36.361445 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ae88a899-7385-4b5a-b095-2d083c5b7d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:36.476520 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88a899-7385-4b5a-b095-2d083c5b7d79 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:36.485609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e739264-33d8-4476-8c0b-c132da41ca38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:36.486493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e739264-33d8-4476-8c0b-c132da41ca38 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:36.486950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e739264-33d8-4476-8c0b-c132da41ca38 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:36.487366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e739264-33d8-4476-8c0b-c132da41ca38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:36.501531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e739264-33d8-4476-8c0b-c132da41ca38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:36.504015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e739264-33d8-4476-8c0b-c132da41ca38 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:36.518596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1150/2281] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:11:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:11:39.634211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff357c1-c9bb-4ffb-a4c7-e1dd91860051 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:39.634211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff357c1-c9bb-4ffb-a4c7-e1dd91860051 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:39.634211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff357c1-c9bb-4ffb-a4c7-e1dd91860051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:39.675043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-dff357c1-c9bb-4ffb-a4c7-e1dd91860051 None None] MFA Rules not processed for user `69b002cc0f9942b7be08ad6b003284be`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:39.676306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-dff357c1-c9bb-4ffb-a4c7-e1dd91860051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:39.768873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1132/2282] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:11:39.782293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e739264-33d8-4476-8c0b-c132da41ca38 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:39.783854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6e739264-33d8-4476-8c0b-c132da41ca38 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:39.850952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e739264-33d8-4476-8c0b-c132da41ca38 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:39.866876 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5ffa-6001-44c9-896b-30ebb39926cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18138af1ea504faca84b0cc2034ddd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:39.867812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5ffa-6001-44c9-896b-30ebb39926cf service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:39.868979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5ffa-6001-44c9-896b-30ebb39926cf service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:39.869625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5ffa-6001-44c9-896b-30ebb39926cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:39.885085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:39.940813 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de5ffa-6001-44c9-896b-30ebb39926cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:39.942875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de5ffa-6001-44c9-896b-30ebb39926cf service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:39.952828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1151/2283] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:40.332746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033f025-6cbd-48e2-b41d-57994525080c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:40.333063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033f025-6cbd-48e2-b41d-57994525080c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:40.333340 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033f025-6cbd-48e2-b41d-57994525080c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:40.353254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-6033f025-6cbd-48e2-b41d-57994525080c None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:40.355565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6033f025-6cbd-48e2-b41d-57994525080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:40.363511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1133/2284] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:11:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:40.386328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5ffa-6001-44c9-896b-30ebb39926cf service glance] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:40.398173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5ffa-6001-44c9-896b-30ebb39926cf service glance] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:40.408535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24453d-56ca-425a-a360-43ba7a0b81e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:40.408535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24453d-56ca-425a-a360-43ba7a0b81e0 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:40.408535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24453d-56ca-425a-a360-43ba7a0b81e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:40.408535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24453d-56ca-425a-a360-43ba7a0b81e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:40.417338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24453d-56ca-425a-a360-43ba7a0b81e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:40.419045 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24453d-56ca-425a-a360-43ba7a0b81e0 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:40.429298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1152/2285] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:11:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:11:42.865204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a05db0-a39e-442a-9215-9f40cbaab3c5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:42.865204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a05db0-a39e-442a-9215-9f40cbaab3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:42.865670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a05db0-a39e-442a-9215-9f40cbaab3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:42.891804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-e0a05db0-a39e-442a-9215-9f40cbaab3c5 None None] MFA Rules not processed for user `7b48b352a5514bab8651977f5f9ef040`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:42.897678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e0a05db0-a39e-442a-9215-9f40cbaab3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:42.952948 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:43.015535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1134/2286] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:45.936202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24453d-56ca-425a-a360-43ba7a0b81e0 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:11:45.938815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ce24453d-56ca-425a-a360-43ba7a0b81e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:46.043168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24453d-56ca-425a-a360-43ba7a0b81e0 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:11:46.053387 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657945-db18-42e0-9b18-4c4f76922a7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:11:46.054083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657945-db18-42e0-9b18-4c4f76922a7a service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:46.054366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657945-db18-42e0-9b18-4c4f76922a7a service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:46.054694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657945-db18-42e0-9b18-4c4f76922a7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:46.056700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4d657945-db18-42e0-9b18-4c4f76922a7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:46.070536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657945-db18-42e0-9b18-4c4f76922a7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:11:46.072279 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657945-db18-42e0-9b18-4c4f76922a7a service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:11:46.085914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1153/2287] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:11:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:11:52.995691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=11 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:53.246399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab2a60-967a-4374-8bd9-7f911726356d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:11:53.246687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab2a60-967a-4374-8bd9-7f911726356d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:11:53.246970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab2a60-967a-4374-8bd9-7f911726356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:11:53.266109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-dfab2a60-967a-4374-8bd9-7f911726356d None None] MFA Rules not processed for user `b7f2bda7559e408183484833bf8935ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:11:53.267306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-dfab2a60-967a-4374-8bd9-7f911726356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:11:53.274124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1135/2288] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:11:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:11:56.078933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=61 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:00.123960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108ec9a-0786-4b4d-b8c9-a07611b91e6d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:00.123960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108ec9a-0786-4b4d-b8c9-a07611b91e6d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:00.123960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108ec9a-0786-4b4d-b8c9-a07611b91e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:00.131852 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4108ec9a-0786-4b4d-b8c9-a07611b91e6d None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:00.133064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4108ec9a-0786-4b4d-b8c9-a07611b91e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:00.140468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1154/2289] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:12:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:00.152525 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab2a60-967a-4374-8bd9-7f911726356d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:00.170084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab2a60-967a-4374-8bd9-7f911726356d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:00.176398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b3a9f-b743-4d78-ac02-92f3eaf457a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:00.177047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b3a9f-b743-4d78-ac02-92f3eaf457a0 service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:00.177370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b3a9f-b743-4d78-ac02-92f3eaf457a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:00.177592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b3a9f-b743-4d78-ac02-92f3eaf457a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:00.191852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b3a9f-b743-4d78-ac02-92f3eaf457a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:00.193767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b3a9f-b743-4d78-ac02-92f3eaf457a0 service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:00.203933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1136/2290] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:12:10.126244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:10.200470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=9 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:18.591524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760bc3c-78b0-4270-8492-cc119d781770 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:18.595667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760bc3c-78b0-4270-8492-cc119d781770 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:18.595667 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760bc3c-78b0-4270-8492-cc119d781770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:18.612373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9760bc3c-78b0-4270-8492-cc119d781770 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:18.613951 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9760bc3c-78b0-4270-8492-cc119d781770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:18.678140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1155/2291] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:18.700826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b3a9f-b743-4d78-ac02-92f3eaf457a0 service swift] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:18.702363 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-311b3a9f-b743-4d78-ac02-92f3eaf457a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:18.775386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b3a9f-b743-4d78-ac02-92f3eaf457a0 service swift] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:18.780845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359a337-9e76-46fd-ac82-ef85353e4d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:18.781774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359a337-9e76-46fd-ac82-ef85353e4d4f service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:18.782058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359a337-9e76-46fd-ac82-ef85353e4d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:18.782332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359a337-9e76-46fd-ac82-ef85353e4d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:18.790968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359a337-9e76-46fd-ac82-ef85353e4d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:18.793452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359a337-9e76-46fd-ac82-ef85353e4d4f service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:18.802402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1137/2292] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:26.094380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb98014-2aee-45e3-b22d-8bc91232145d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:26.094935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb98014-2aee-45e3-b22d-8bc91232145d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:26.094935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb98014-2aee-45e3-b22d-8bc91232145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:26.114795 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4cb98014-2aee-45e3-b22d-8bc91232145d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:26.116017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4cb98014-2aee-45e3-b22d-8bc91232145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:26.124198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1156/2293] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:26.149793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359a337-9e76-46fd-ac82-ef85353e4d4f service nova] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:26.162046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359a337-9e76-46fd-ac82-ef85353e4d4f service nova] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:26.168627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a62bab-827b-4b7f-b0ee-4c86bede63bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:26.169255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a62bab-827b-4b7f-b0ee-4c86bede63bf service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:26.169541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a62bab-827b-4b7f-b0ee-4c86bede63bf service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:26.169814 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a62bab-827b-4b7f-b0ee-4c86bede63bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:26.179037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a62bab-827b-4b7f-b0ee-4c86bede63bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:26.180651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a62bab-827b-4b7f-b0ee-4c86bede63bf service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:26.190433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1138/2294] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:30.719058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44803abe-1b26-4874-9a1e-7dc689a92968 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:30.719522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44803abe-1b26-4874-9a1e-7dc689a92968 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:30.719728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44803abe-1b26-4874-9a1e-7dc689a92968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:30.739349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-44803abe-1b26-4874-9a1e-7dc689a92968 None None] MFA Rules not processed for user `9b585090272c4b4ab7d1937ebc9fa649`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:30.745128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-44803abe-1b26-4874-9a1e-7dc689a92968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:30.800557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1157/2295] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:12:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:31.662569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5b608-f6d4-4bba-a26e-8e9dd42ecd84 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:31.663140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5b608-f6d4-4bba-a26e-8e9dd42ecd84 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:31.663723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5b608-f6d4-4bba-a26e-8e9dd42ecd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:31.687108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-cdb5b608-f6d4-4bba-a26e-8e9dd42ecd84 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:31.688336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cdb5b608-f6d4-4bba-a26e-8e9dd42ecd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:31.697195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1139/2296] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:31.724073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44803abe-1b26-4874-9a1e-7dc689a92968 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:31.738180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44803abe-1b26-4874-9a1e-7dc689a92968 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:31.744210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5a9c-b01c-4b7a-bfbf-640103a7b4de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:31.744931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5a9c-b01c-4b7a-bfbf-640103a7b4de service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:31.748105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5a9c-b01c-4b7a-bfbf-640103a7b4de service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:31.748105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5a9c-b01c-4b7a-bfbf-640103a7b4de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:31.754475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5a9c-b01c-4b7a-bfbf-640103a7b4de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:31.756063 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5a9c-b01c-4b7a-bfbf-640103a7b4de service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:31.766200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1158/2297] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:37.371703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5b608-f6d4-4bba-a26e-8e9dd42ecd84 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:37.373906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cdb5b608-f6d4-4bba-a26e-8e9dd42ecd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:37.465989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5b608-f6d4-4bba-a26e-8e9dd42ecd84 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:37.470043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005be769-b3fc-47c6-a229-ab0d87e1cfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:37.470599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005be769-b3fc-47c6-a229-ab0d87e1cfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:37.470882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005be769-b3fc-47c6-a229-ab0d87e1cfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:37.471185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005be769-b3fc-47c6-a229-ab0d87e1cfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:37.480774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005be769-b3fc-47c6-a229-ab0d87e1cfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:37.482266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005be769-b3fc-47c6-a229-ab0d87e1cfc9 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:37.493011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1140/2298] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:38.731505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc43e5-5946-4759-9263-2c840de34f75 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:38.732101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc43e5-5946-4759-9263-2c840de34f75 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:38.732198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc43e5-5946-4759-9263-2c840de34f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:38.768825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-19dc43e5-5946-4759-9263-2c840de34f75 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:38.771166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-19dc43e5-5946-4759-9263-2c840de34f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:38.803730 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1159/2299] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:38.832535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005be769-b3fc-47c6-a229-ab0d87e1cfc9 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:38.861175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005be769-b3fc-47c6-a229-ab0d87e1cfc9 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:38.875644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ee71-7f28-4d77-ba7d-fc16cd9a5794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:38.876553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ee71-7f28-4d77-ba7d-fc16cd9a5794 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:38.877064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ee71-7f28-4d77-ba7d-fc16cd9a5794 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:38.878665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ee71-7f28-4d77-ba7d-fc16cd9a5794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:38.897355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38ee71-7f28-4d77-ba7d-fc16cd9a5794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:38.904473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38ee71-7f28-4d77-ba7d-fc16cd9a5794 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:38.924615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1141/2300] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:44.097053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2de2-f5a0-4a66-9db7-96c1294c5f00 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:44.097550 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2de2-f5a0-4a66-9db7-96c1294c5f00 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:44.097678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2de2-f5a0-4a66-9db7-96c1294c5f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:44.107496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=65 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:44.141062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d06a2de2-f5a0-4a66-9db7-96c1294c5f00 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:44.142321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d06a2de2-f5a0-4a66-9db7-96c1294c5f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:44.163408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1160/2301] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:44.192950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ee71-7f28-4d77-ba7d-fc16cd9a5794 service nova] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:44.199315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=76 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:44.208707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ee71-7f28-4d77-ba7d-fc16cd9a5794 service nova] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:44.219111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20948-917d-472c-a88c-a9f3c24a3c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:44.219756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20948-917d-472c-a88c-a9f3c24a3c78 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:44.220041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20948-917d-472c-a88c-a9f3c24a3c78 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:44.220317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20948-917d-472c-a88c-a9f3c24a3c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:44.233221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20948-917d-472c-a88c-a9f3c24a3c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:44.235707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20948-917d-472c-a88c-a9f3c24a3c78 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:44.268615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1142/2302] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:45.923658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efdba8-1894-46b4-9d80-a74e2e98e642 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:45.923658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efdba8-1894-46b4-9d80-a74e2e98e642 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:45.924226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efdba8-1894-46b4-9d80-a74e2e98e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:45.945817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-84efdba8-1894-46b4-9d80-a74e2e98e642 None None] MFA Rules not processed for user `e01fd82a1ff44587b45f72f82e1562a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:45.946999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-84efdba8-1894-46b4-9d80-a74e2e98e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:46.001107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1161/2303] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:48.432873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb672c5-5f65-45aa-ac50-a2414078fe55 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:48.433473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb672c5-5f65-45aa-ac50-a2414078fe55 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:48.433590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb672c5-5f65-45aa-ac50-a2414078fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:48.453192 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-feb672c5-5f65-45aa-ac50-a2414078fe55 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:12:48.454379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-feb672c5-5f65-45aa-ac50-a2414078fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:12:48.463310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1143/2304] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:12:48.492998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efdba8-1894-46b4-9d80-a74e2e98e642 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:12:48.505787 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efdba8-1894-46b4-9d80-a74e2e98e642 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:12:48.511360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91ec5c-dab9-4135-98a5-3006db9edfac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:12:48.512055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91ec5c-dab9-4135-98a5-3006db9edfac service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:12:48.512338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91ec5c-dab9-4135-98a5-3006db9edfac service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:12:48.512614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91ec5c-dab9-4135-98a5-3006db9edfac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:12:48.523709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91ec5c-dab9-4135-98a5-3006db9edfac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:12:48.525375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91ec5c-dab9-4135-98a5-3006db9edfac service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:12:48.536166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1162/2305] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:12:58.448459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=8 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:58.531085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=33 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:12.739963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cbda-7faf-4daa-b9c4-aa6176b352c8 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:12.740553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cbda-7faf-4daa-b9c4-aa6176b352c8 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:12.740553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cbda-7faf-4daa-b9c4-aa6176b352c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:12.759372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a204cbda-7faf-4daa-b9c4-aa6176b352c8 None None] MFA Rules not processed for user `5c9bcec78f08499dba7b64b4d21ceddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:13:12.763096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a204cbda-7faf-4daa-b9c4-aa6176b352c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:12.820427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1144/2306] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:13:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:13:22.811912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=25 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:25.768157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3fc1a-10dc-4392-8eaf-60e60a3a84ac None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:25.768689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3fc1a-10dc-4392-8eaf-60e60a3a84ac None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:25.768689 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3fc1a-10dc-4392-8eaf-60e60a3a84ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:25.789002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-78b3fc1a-10dc-4392-8eaf-60e60a3a84ac None None] MFA Rules not processed for user `7388d3603bbd428cabf62a1f46e73929`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:13:25.790335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-78b3fc1a-10dc-4392-8eaf-60e60a3a84ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:25.854384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1163/2307] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:13:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:13:26.237070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cbda-7faf-4daa-b9c4-aa6176b352c8 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:26.247858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cbda-7faf-4daa-b9c4-aa6176b352c8 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:26.253884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de65e6-a2e5-4034-bd6f-818a8fcb35c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:26.253884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de65e6-a2e5-4034-bd6f-818a8fcb35c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:26.253884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de65e6-a2e5-4034-bd6f-818a8fcb35c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:26.253884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de65e6-a2e5-4034-bd6f-818a8fcb35c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:26.255819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-61de65e6-a2e5-4034-bd6f-818a8fcb35c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:26.270273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de65e6-a2e5-4034-bd6f-818a8fcb35c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:26.271714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de65e6-a2e5-4034-bd6f-818a8fcb35c6 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:26.283612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1145/2308] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:13:29.528962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3fc1a-10dc-4392-8eaf-60e60a3a84ac None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:29.538844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3fc1a-10dc-4392-8eaf-60e60a3a84ac None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:29.542548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdf666-e1c4-455c-bab3-28912cb8eeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:29.543162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdf666-e1c4-455c-bab3-28912cb8eeae service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:29.543447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdf666-e1c4-455c-bab3-28912cb8eeae service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:29.543720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdf666-e1c4-455c-bab3-28912cb8eeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:29.545493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3dcdf666-e1c4-455c-bab3-28912cb8eeae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:29.559713 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdf666-e1c4-455c-bab3-28912cb8eeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:29.561200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdf666-e1c4-455c-bab3-28912cb8eeae service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:29.573575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1164/2309] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:13:36.278100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=6 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:36.395434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699e527-5f12-47cd-b56a-f0bf8d2137da None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:36.395721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699e527-5f12-47cd-b56a-f0bf8d2137da None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:36.395998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699e527-5f12-47cd-b56a-f0bf8d2137da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:36.417839 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8699e527-5f12-47cd-b56a-f0bf8d2137da None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:13:36.419094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8699e527-5f12-47cd-b56a-f0bf8d2137da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:36.427555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1146/2310] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:13:36.453479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdf666-e1c4-455c-bab3-28912cb8eeae service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:36.465581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdf666-e1c4-455c-bab3-28912cb8eeae service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:36.471191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8010d-9792-42f0-8155-9ac67afeb3ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:36.471793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8010d-9792-42f0-8155-9ac67afeb3ca service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:36.472073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8010d-9792-42f0-8155-9ac67afeb3ca service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:36.472345 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8010d-9792-42f0-8155-9ac67afeb3ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:36.480368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8010d-9792-42f0-8155-9ac67afeb3ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:36.482015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8010d-9792-42f0-8155-9ac67afeb3ca service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:36.491354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1165/2311] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:13:41.532560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e754-83c4-4aff-b8d3-6e09c4eda6bc None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:41.533152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e754-83c4-4aff-b8d3-6e09c4eda6bc None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:41.533152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e754-83c4-4aff-b8d3-6e09c4eda6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:41.552294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-bab2e754-83c4-4aff-b8d3-6e09c4eda6bc None None] MFA Rules not processed for user `7b48b352a5514bab8651977f5f9ef040`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:13:41.553520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bab2e754-83c4-4aff-b8d3-6e09c4eda6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:41.560330 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1147/2312] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:13:43.197826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a83e1-3d0d-41b1-bced-d46022c409da None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:43.198402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a83e1-3d0d-41b1-bced-d46022c409da None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:43.198402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a83e1-3d0d-41b1-bced-d46022c409da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:43.218154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-652a83e1-3d0d-41b1-bced-d46022c409da None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:13:43.219368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-652a83e1-3d0d-41b1-bced-d46022c409da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:43.228130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1166/2313] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:13:43.261755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2e754-83c4-4aff-b8d3-6e09c4eda6bc None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:43.266172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bab2e754-83c4-4aff-b8d3-6e09c4eda6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:43.279564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2e754-83c4-4aff-b8d3-6e09c4eda6bc None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:43.285092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed600d-7892-41a5-a17f-5289ffb25c2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:43.285737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed600d-7892-41a5-a17f-5289ffb25c2c service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:43.286069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed600d-7892-41a5-a17f-5289ffb25c2c service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:43.286359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed600d-7892-41a5-a17f-5289ffb25c2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:43.294963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed600d-7892-41a5-a17f-5289ffb25c2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:43.296564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed600d-7892-41a5-a17f-5289ffb25c2c service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:43.306775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1148/2314] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:13:47.015505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0ee6d-6017-40b0-9335-589eda11a367 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:47.016001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0ee6d-6017-40b0-9335-589eda11a367 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:47.020047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0ee6d-6017-40b0-9335-589eda11a367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:47.036487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d7a0ee6d-6017-40b0-9335-589eda11a367 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:13:47.037719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d7a0ee6d-6017-40b0-9335-589eda11a367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:47.046012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1167/2315] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:13:47.059326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed600d-7892-41a5-a17f-5289ffb25c2c service nova] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:47.068574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed600d-7892-41a5-a17f-5289ffb25c2c service nova] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:47.072632 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d773-9025-4261-9977-893f9d81a508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:47.073258 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d773-9025-4261-9977-893f9d81a508 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:47.073535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d773-9025-4261-9977-893f9d81a508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:47.073806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d773-9025-4261-9977-893f9d81a508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:47.075718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0398d773-9025-4261-9977-893f9d81a508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:47.084044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0ee6d-6017-40b0-9335-589eda11a367 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:47.087236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d773-9025-4261-9977-893f9d81a508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:47.088670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d773-9025-4261-9977-893f9d81a508 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:47.097035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0ee6d-6017-40b0-9335-589eda11a367 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:47.100199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1149/2316] 10.222.0.67 () {60 vars in 1396 bytes} [Thu Jul 28 18:13:47 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:13:47.102951 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3a5a4-6cff-4c9d-825b-0cb3ee11d783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:47.103655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3a5a4-6cff-4c9d-825b-0cb3ee11d783 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:47.104011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3a5a4-6cff-4c9d-825b-0cb3ee11d783 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:47.104349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3a5a4-6cff-4c9d-825b-0cb3ee11d783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:47.113118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3a5a4-6cff-4c9d-825b-0cb3ee11d783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:47.114709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3a5a4-6cff-4c9d-825b-0cb3ee11d783 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:47.124774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1168/2317] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:13:51.085557 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d773-9025-4261-9977-893f9d81a508 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:51.098774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d773-9025-4261-9977-893f9d81a508 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:51.105195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a6ec-d055-474e-ac3e-c132028cc2a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:51.105829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a6ec-d055-474e-ac3e-c132028cc2a6 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:51.106100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a6ec-d055-474e-ac3e-c132028cc2a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:51.106400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a6ec-d055-474e-ac3e-c132028cc2a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:51.108206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1c68a6ec-d055-474e-ac3e-c132028cc2a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:51.120557 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a6ec-d055-474e-ac3e-c132028cc2a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:51.122161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a6ec-d055-474e-ac3e-c132028cc2a6 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:51.132315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1150/2318] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:13:53.329214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604904e9-edfc-47ae-a729-17d911a9619e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:53.329723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604904e9-edfc-47ae-a729-17d911a9619e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:53.329854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604904e9-edfc-47ae-a729-17d911a9619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:53.337494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=50 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:53.349637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-604904e9-edfc-47ae-a729-17d911a9619e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:13:53.350962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-604904e9-edfc-47ae-a729-17d911a9619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:53.358748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1169/2319] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:13:53.383703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a6ec-d055-474e-ac3e-c132028cc2a6 service nova] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:53.394933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a6ec-d055-474e-ac3e-c132028cc2a6 service nova] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:53.400385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddb48e-b5be-4d5e-98b1-1dbabf77f88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:53.401060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddb48e-b5be-4d5e-98b1-1dbabf77f88d service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:53.401344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddb48e-b5be-4d5e-98b1-1dbabf77f88d service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:53.401621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddb48e-b5be-4d5e-98b1-1dbabf77f88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:53.409830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddb48e-b5be-4d5e-98b1-1dbabf77f88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:53.412412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddb48e-b5be-4d5e-98b1-1dbabf77f88d service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:53.421911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1151/2320] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:13:54.570052 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604904e9-edfc-47ae-a729-17d911a9619e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:54.579939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604904e9-edfc-47ae-a729-17d911a9619e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:54.583758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf0cc-014e-4d42-8f65-8ac73f2c06f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:54.584997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf0cc-014e-4d42-8f65-8ac73f2c06f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:54.585286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf0cc-014e-4d42-8f65-8ac73f2c06f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:54.585556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf0cc-014e-4d42-8f65-8ac73f2c06f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:54.587386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d8baf0cc-014e-4d42-8f65-8ac73f2c06f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:54.597501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baf0cc-014e-4d42-8f65-8ac73f2c06f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:54.598939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baf0cc-014e-4d42-8f65-8ac73f2c06f6 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:54.606749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1170/2321] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:13:57.606110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb902d1a-1056-4a80-ba15-ab7a56b803a6 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:57.606630 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb902d1a-1056-4a80-ba15-ab7a56b803a6 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:57.606745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb902d1a-1056-4a80-ba15-ab7a56b803a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:57.626696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-eb902d1a-1056-4a80-ba15-ab7a56b803a6 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:13:57.627912 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-eb902d1a-1056-4a80-ba15-ab7a56b803a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:13:57.636153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1152/2322] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Jul 28 18:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:13:57.675916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf0cc-014e-4d42-8f65-8ac73f2c06f6 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:13:57.689297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf0cc-014e-4d42-8f65-8ac73f2c06f6 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:13:57.694969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04affa-968c-40dd-a8f5-95ada6df64c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:13:57.695570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04affa-968c-40dd-a8f5-95ada6df64c5 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:13:57.695852 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04affa-968c-40dd-a8f5-95ada6df64c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:13:57.696125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04affa-968c-40dd-a8f5-95ada6df64c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:13:57.705861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04affa-968c-40dd-a8f5-95ada6df64c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:13:57.707432 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04affa-968c-40dd-a8f5-95ada6df64c5 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:13:57.717408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1171/2323] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:03.493532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb902d1a-1056-4a80-ba15-ab7a56b803a6 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:03.506101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb902d1a-1056-4a80-ba15-ab7a56b803a6 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:03.512118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c596-c6a3-4617-8ab1-54b486c35248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:03.512724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c596-c6a3-4617-8ab1-54b486c35248 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:03.513039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c596-c6a3-4617-8ab1-54b486c35248 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:03.513315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c596-c6a3-4617-8ab1-54b486c35248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:03.515085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8062c596-c6a3-4617-8ab1-54b486c35248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:03.526410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062c596-c6a3-4617-8ab1-54b486c35248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:03.528009 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062c596-c6a3-4617-8ab1-54b486c35248 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:03.536905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1153/2324] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:05.671808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04affa-968c-40dd-a8f5-95ada6df64c5 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:05.689825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04affa-968c-40dd-a8f5-95ada6df64c5 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:05.701637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b5e99-d384-49f0-98c3-a05daa02b988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:05.702278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b5e99-d384-49f0-98c3-a05daa02b988 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:05.703201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b5e99-d384-49f0-98c3-a05daa02b988 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:05.703201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b5e99-d384-49f0-98c3-a05daa02b988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:05.704907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a91b5e99-d384-49f0-98c3-a05daa02b988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:05.719557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b5e99-d384-49f0-98c3-a05daa02b988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:05.721580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b5e99-d384-49f0-98c3-a05daa02b988 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:05.741553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1172/2325] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:13.532711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=39 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:15.729609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=20 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:17.249055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd659ca-004a-41b4-b1ec-c43108c8d5bc None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:17.249571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd659ca-004a-41b4-b1ec-c43108c8d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:17.249682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd659ca-004a-41b4-b1ec-c43108c8d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:17.269241 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-5bd659ca-004a-41b4-b1ec-c43108c8d5bc None None] MFA Rules not processed for user `9b585090272c4b4ab7d1937ebc9fa649`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:17.270554 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5bd659ca-004a-41b4-b1ec-c43108c8d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:17.277511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1154/2326] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:14:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:17.653442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b5e99-d384-49f0-98c3-a05daa02b988 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:17.662419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b5e99-d384-49f0-98c3-a05daa02b988 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:17.666751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb012b4b-b252-4d02-b03a-1372a4791c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:17.667359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb012b4b-b252-4d02-b03a-1372a4791c92 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:17.667639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb012b4b-b252-4d02-b03a-1372a4791c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:17.667913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb012b4b-b252-4d02-b03a-1372a4791c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:17.669666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-eb012b4b-b252-4d02-b03a-1372a4791c92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:17.678941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb012b4b-b252-4d02-b03a-1372a4791c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:17.680948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb012b4b-b252-4d02-b03a-1372a4791c92 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:17.688641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1173/2327] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:18.093928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd659ca-004a-41b4-b1ec-c43108c8d5bc None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:18.106396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd659ca-004a-41b4-b1ec-c43108c8d5bc None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:18.111350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ec167-cbd9-45dd-a4a0-764d71ea2f50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:18.112745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ec167-cbd9-45dd-a4a0-764d71ea2f50 service placement] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:18.112745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ec167-cbd9-45dd-a4a0-764d71ea2f50 service placement] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:18.112745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ec167-cbd9-45dd-a4a0-764d71ea2f50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:18.114468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-452ec167-cbd9-45dd-a4a0-764d71ea2f50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:18.127337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ec167-cbd9-45dd-a4a0-764d71ea2f50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:18.128965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ec167-cbd9-45dd-a4a0-764d71ea2f50 service placement] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:18.139530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1155/2328] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:27.685256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:28.134926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=9 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:30.008230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb012b4b-b252-4d02-b03a-1372a4791c92 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:30.025795 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb012b4b-b252-4d02-b03a-1372a4791c92 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:30.029682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33835877-3624-438a-8b40-bf85994d619f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:30.030292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835877-3624-438a-8b40-bf85994d619f service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:30.030571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835877-3624-438a-8b40-bf85994d619f service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:30.030840 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835877-3624-438a-8b40-bf85994d619f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:30.032803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-33835877-3624-438a-8b40-bf85994d619f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:30.045984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33835877-3624-438a-8b40-bf85994d619f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:30.059452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33835877-3624-438a-8b40-bf85994d619f service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:30.059699 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1174/2329] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:36.108603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668843a-17b7-43a6-afee-611eec122529 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:36.109164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668843a-17b7-43a6-afee-611eec122529 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:36.109164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668843a-17b7-43a6-afee-611eec122529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:36.129396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7668843a-17b7-43a6-afee-611eec122529 None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:36.130659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7668843a-17b7-43a6-afee-611eec122529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:36.138024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1156/2330] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:14:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:36.185512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33835877-3624-438a-8b40-bf85994d619f service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:36.197122 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33835877-3624-438a-8b40-bf85994d619f service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:36.202132 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e367d24-e186-449a-890a-5bd88785c011 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:36.202724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e367d24-e186-449a-890a-5bd88785c011 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:36.203000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e367d24-e186-449a-890a-5bd88785c011 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:36.203288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e367d24-e186-449a-890a-5bd88785c011 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:36.211808 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e367d24-e186-449a-890a-5bd88785c011 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:36.213398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e367d24-e186-449a-890a-5bd88785c011 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:36.222751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1175/2331] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:14:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:14:37.119529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668843a-17b7-43a6-afee-611eec122529 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:37.121493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7668843a-17b7-43a6-afee-611eec122529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:37.144137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668843a-17b7-43a6-afee-611eec122529 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:37.149818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c7ce1-5be9-40e0-833a-7144bb4f77b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:37.153367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c7ce1-5be9-40e0-833a-7144bb4f77b7 service placement] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:37.153367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c7ce1-5be9-40e0-833a-7144bb4f77b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:37.153367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c7ce1-5be9-40e0-833a-7144bb4f77b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:37.153760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f54c7ce1-5be9-40e0-833a-7144bb4f77b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:37.168737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c7ce1-5be9-40e0-833a-7144bb4f77b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:37.170684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c7ce1-5be9-40e0-833a-7144bb4f77b7 service placement] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:37.194382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1157/2332] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:37.258725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e367d24-e186-449a-890a-5bd88785c011 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:37.260226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6e367d24-e186-449a-890a-5bd88785c011 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:37.275347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e367d24-e186-449a-890a-5bd88785c011 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:37.291921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:37.292593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:37.292904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:37.293314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] PATH_INFO: `/v3/users/5c9bcec78f08499dba7b64b4d21ceddd` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:37.294627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9bcec78f08499dba7b64b4d21ceddd)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:37.301704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:37.497178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9bcec78f08499dba7b64b4d21ceddd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:37.499839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9bcec78f08499dba7b64b4d21ceddd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:37.515837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9bcec78f08499dba7b64b4d21ceddd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:37.516952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9bcec78f08499dba7b64b4d21ceddd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:37.532549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8d12f0ba-a5e6-4f6a-a203-c7eff88456f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9bcec78f08499dba7b64b4d21ceddd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:37.665993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1176/2333] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:14:37 2022] DELETE /identity/v3/users/5c9bcec78f08499dba7b64b4d21ceddd => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:14:38.144304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c7ce1-5be9-40e0-833a-7144bb4f77b7 service placement] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:38.169959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c7ce1-5be9-40e0-833a-7144bb4f77b7 service placement] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:38.259571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:38.260567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:38.261042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:38.261479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] PATH_INFO: `/v3/projects/d7475c64d7fd41139d021ab27215b194` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:38.262914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7475c64d7fd41139d021ab27215b194)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:38.265092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:38.603044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7475c64d7fd41139d021ab27215b194', 'request_id': 'req-399b46bf-7006-46ed-937e-8cac0e38efff'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:38.613734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7475c64d7fd41139d021ab27215b194', 'request_id': 'req-399b46bf-7006-46ed-937e-8cac0e38efff'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:38.727567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7475c64d7fd41139d021ab27215b194', 'request_id': 'req-399b46bf-7006-46ed-937e-8cac0e38efff'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:38.743840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] The token cache is being invalidate because project d7475c64d7fd41139d021ab27215b194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:14:38.744502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:38.745232 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-399b46bf-7006-46ed-937e-8cac0e38efff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:38.746996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1158/2334] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:14:38 2022] DELETE /identity/v3/projects/d7475c64d7fd41139d021ab27215b194 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:14:38.751714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb3fce-4bcb-4a67-a4f5-c31792750700 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:38.752264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb3fce-4bcb-4a67-a4f5-c31792750700 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:38.752264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb3fce-4bcb-4a67-a4f5-c31792750700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:38.776673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-72cb3fce-4bcb-4a67-a4f5-c31792750700 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:38.778057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-72cb3fce-4bcb-4a67-a4f5-c31792750700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:38.851917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1177/2335] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:38.860294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fc9cd-b8fb-4521-b6b7-4b8a858cefcd None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:38.860531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fc9cd-b8fb-4521-b6b7-4b8a858cefcd None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:38.860851 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fc9cd-b8fb-4521-b6b7-4b8a858cefcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:38.880771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-db5fc9cd-b8fb-4521-b6b7-4b8a858cefcd None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:38.882002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-db5fc9cd-b8fb-4521-b6b7-4b8a858cefcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:38.889940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1159/2336] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:38.894098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb3fce-4bcb-4a67-a4f5-c31792750700 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:38.904510 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb3fce-4bcb-4a67-a4f5-c31792750700 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:38.909169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5a644-0083-497c-be1f-1880a9a10513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:38.909772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a644-0083-497c-be1f-1880a9a10513 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:38.910053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a644-0083-497c-be1f-1880a9a10513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:38.910351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a644-0083-497c-be1f-1880a9a10513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:38.911014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5a644-0083-497c-be1f-1880a9a10513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:14:38.911316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5a644-0083-497c-be1f-1880a9a10513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:38.912986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5a644-0083-497c-be1f-1880a9a10513 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:38.925211 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1178/2337] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:14:38.929938 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fc9cd-b8fb-4521-b6b7-4b8a858cefcd None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:38.939417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fc9cd-b8fb-4521-b6b7-4b8a858cefcd None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:38.944222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6993a5-8dd7-4d3f-afa1-770f278de8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:38.944857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6993a5-8dd7-4d3f-afa1-770f278de8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:38.945142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6993a5-8dd7-4d3f-afa1-770f278de8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:38.945415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6993a5-8dd7-4d3f-afa1-770f278de8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:38.946102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6993a5-8dd7-4d3f-afa1-770f278de8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:38.947996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6993a5-8dd7-4d3f-afa1-770f278de8a9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:39.100521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1160/2338] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:14:38 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:14:39.103491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5a644-0083-497c-be1f-1880a9a10513 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:39.114583 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5a644-0083-497c-be1f-1880a9a10513 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:39.155596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:39.209618 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e3194-f75e-4d4e-b463-12c0b5c3a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:39.210352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e3194-f75e-4d4e-b463-12c0b5c3a429 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:39.211246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e3194-f75e-4d4e-b463-12c0b5c3a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:39.211675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e3194-f75e-4d4e-b463-12c0b5c3a429 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:39.212348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e3194-f75e-4d4e-b463-12c0b5c3a429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:39.214340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e3194-f75e-4d4e-b463-12c0b5c3a429 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:39.350288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1179/2339] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:14:39 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:14:39.356571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6993a5-8dd7-4d3f-afa1-770f278de8a9 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:39.369859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6993a5-8dd7-4d3f-afa1-770f278de8a9 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:39.386818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b45c6-4679-4a4b-a92c-74e068f4658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:39.388631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b45c6-4679-4a4b-a92c-74e068f4658d admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:39.389193 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b45c6-4679-4a4b-a92c-74e068f4658d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:39.389676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b45c6-4679-4a4b-a92c-74e068f4658d admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:39.391198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b45c6-4679-4a4b-a92c-74e068f4658d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:39.393598 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b45c6-4679-4a4b-a92c-74e068f4658d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:39.421534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1161/2340] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:14:39.426155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e3194-f75e-4d4e-b463-12c0b5c3a429 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:39.442100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e3194-f75e-4d4e-b463-12c0b5c3a429 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:39.450746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b387c0-42b7-4569-b97f-3371e8a3746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:39.451438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b387c0-42b7-4569-b97f-3371e8a3746e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:39.451726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b387c0-42b7-4569-b97f-3371e8a3746e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:39.452003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b387c0-42b7-4569-b97f-3371e8a3746e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:39.452713 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b387c0-42b7-4569-b97f-3371e8a3746e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:39.454434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b387c0-42b7-4569-b97f-3371e8a3746e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:39.470465 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1180/2341] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:14:39.476505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b45c6-4679-4a4b-a92c-74e068f4658d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:39.485750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b45c6-4679-4a4b-a92c-74e068f4658d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:39.493072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9988e-73bf-469b-8fea-48d79a085923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:39.493763 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9988e-73bf-469b-8fea-48d79a085923 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:39.494039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9988e-73bf-469b-8fea-48d79a085923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:39.494520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9988e-73bf-469b-8fea-48d79a085923 admin admin] PATH_INFO: `/v3/projects/e4e027e495f84128ba699b88d02e1df1/users/1fab7e657df74ac197fd28e13c16ee3a/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:39.513854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9988e-73bf-469b-8fea-48d79a085923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e027e495f84128ba699b88d02e1df1, user_id=1fab7e657df74ac197fd28e13c16ee3a, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:39.516907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9988e-73bf-469b-8fea-48d79a085923 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:39.607073 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1162/2342] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:14:39 2022] PUT /identity/v3/projects/e4e027e495f84128ba699b88d02e1df1/users/1fab7e657df74ac197fd28e13c16ee3a/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:14:39.619426 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff453ff-91bd-439f-8bb5-e8c61d12821d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:39.619686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff453ff-91bd-439f-8bb5-e8c61d12821d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:39.619916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff453ff-91bd-439f-8bb5-e8c61d12821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:39.654568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6ff453ff-91bd-439f-8bb5-e8c61d12821d None None] MFA Rules not processed for user `1fab7e657df74ac197fd28e13c16ee3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:39.655822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6ff453ff-91bd-439f-8bb5-e8c61d12821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:39.743702 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1181/2343] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:14:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:39.757190 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9988e-73bf-469b-8fea-48d79a085923 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:39.760560 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e1c9988e-73bf-469b-8fea-48d79a085923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:39.776107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:39.855229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9988e-73bf-469b-8fea-48d79a085923 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:39.859194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e5c19-63fe-418b-857b-dc9f10c2d541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:39.859798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e5c19-63fe-418b-857b-dc9f10c2d541 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:39.860082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e5c19-63fe-418b-857b-dc9f10c2d541 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:39.860355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e5c19-63fe-418b-857b-dc9f10c2d541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:39.870746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e5c19-63fe-418b-857b-dc9f10c2d541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:39.872123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e5c19-63fe-418b-857b-dc9f10c2d541 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:39.886940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1163/2344] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:48.563196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff453ff-91bd-439f-8bb5-e8c61d12821d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:48.567270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6ff453ff-91bd-439f-8bb5-e8c61d12821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:48.708393 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff453ff-91bd-439f-8bb5-e8c61d12821d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:48.720680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77649de-02e1-456c-a60e-d824aff7fe3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:48.721598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77649de-02e1-456c-a60e-d824aff7fe3c service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:48.721980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77649de-02e1-456c-a60e-d824aff7fe3c service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:48.722350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77649de-02e1-456c-a60e-d824aff7fe3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:48.724350 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d77649de-02e1-456c-a60e-d824aff7fe3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:48.742787 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77649de-02e1-456c-a60e-d824aff7fe3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:48.745191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77649de-02e1-456c-a60e-d824aff7fe3c service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:48.765726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1182/2345] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:50.179982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=23 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:51.183589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e5c19-63fe-418b-857b-dc9f10c2d541 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:51.196726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e5c19-63fe-418b-857b-dc9f10c2d541 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:51.202164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28d717-59a1-4aca-b6bb-f038aaede841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:51.202765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d717-59a1-4aca-b6bb-f038aaede841 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:51.203047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d717-59a1-4aca-b6bb-f038aaede841 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:51.203323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28d717-59a1-4aca-b6bb-f038aaede841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:51.205130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6a28d717-59a1-4aca-b6bb-f038aaede841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:51.263253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28d717-59a1-4aca-b6bb-f038aaede841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:51.264867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28d717-59a1-4aca-b6bb-f038aaede841 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:51.274043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1164/2346] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:52.935633 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77649de-02e1-456c-a60e-d824aff7fe3c service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:52.969388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:53.005216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77649de-02e1-456c-a60e-d824aff7fe3c service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:53.011116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:53.011837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:53.012254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:53.012659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] PATH_INFO: `/v3/users/1fab7e657df74ac197fd28e13c16ee3a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:53.014230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fab7e657df74ac197fd28e13c16ee3a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:53.016675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:53.346868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fab7e657df74ac197fd28e13c16ee3a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:53.347448 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fab7e657df74ac197fd28e13c16ee3a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:53.354982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fab7e657df74ac197fd28e13c16ee3a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:53.355621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fab7e657df74ac197fd28e13c16ee3a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:53.367148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fab7e657df74ac197fd28e13c16ee3a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:53.483022 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1183/2347] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:14:52 2022] DELETE /identity/v3/users/1fab7e657df74ac197fd28e13c16ee3a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:14:53.487900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1a70c-f4e7-434d-8482-340d7a62600f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:53.488355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1a70c-f4e7-434d-8482-340d7a62600f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:53.488713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1a70c-f4e7-434d-8482-340d7a62600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:53.510496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8ac1a70c-f4e7-434d-8482-340d7a62600f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:53.512390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8ac1a70c-f4e7-434d-8482-340d7a62600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:53.589735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1165/2348] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:53.608379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:53.608379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:53.681508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad97cc-1760-436f-a044-0821ddc222a9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:53.686057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a733e00-5cad-45a6-b5be-9fadd37af3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:53.686793 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a733e00-5cad-45a6-b5be-9fadd37af3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:53.687074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a733e00-5cad-45a6-b5be-9fadd37af3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:53.687347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a733e00-5cad-45a6-b5be-9fadd37af3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:53.701317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a733e00-5cad-45a6-b5be-9fadd37af3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:53.702904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a733e00-5cad-45a6-b5be-9fadd37af3f8 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:53.714507 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1184/2349] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:54.572607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1a70c-f4e7-434d-8482-340d7a62600f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:54.574703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8ac1a70c-f4e7-434d-8482-340d7a62600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:54.595947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1a70c-f4e7-434d-8482-340d7a62600f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:54.618259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:54.619060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:54.619443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:54.619822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] PATH_INFO: `/v3/projects/e4e027e495f84128ba699b88d02e1df1` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:54.621202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e027e495f84128ba699b88d02e1df1)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:54.623376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:54.772483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e027e495f84128ba699b88d02e1df1', 'request_id': 'req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:54.777922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e027e495f84128ba699b88d02e1df1', 'request_id': 'req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:54.903079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e027e495f84128ba699b88d02e1df1', 'request_id': 'req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:54.914878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] The token cache is being invalidate because project e4e027e495f84128ba699b88d02e1df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:14:54.915160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:54.915800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-f9d71ade-6dec-49ed-a544-1a44a1ce5d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:14:54.917333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1166/2350] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:14:54 2022] DELETE /identity/v3/projects/e4e027e495f84128ba699b88d02e1df1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:14:54.922648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9e59d-bf3d-4f94-8119-1abd2d46adb5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:54.923118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9e59d-bf3d-4f94-8119-1abd2d46adb5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:54.923244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9e59d-bf3d-4f94-8119-1abd2d46adb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:54.943173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8bc9e59d-bf3d-4f94-8119-1abd2d46adb5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:54.944352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8bc9e59d-bf3d-4f94-8119-1abd2d46adb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:54.989152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:55.010799 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1185/2351] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:55.020396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a83b6b-7adb-45e0-8b27-c644e790edb0 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:55.021094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a83b6b-7adb-45e0-8b27-c644e790edb0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:55.021556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a83b6b-7adb-45e0-8b27-c644e790edb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:55.053771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-63a83b6b-7adb-45e0-8b27-c644e790edb0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:55.055476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-63a83b6b-7adb-45e0-8b27-c644e790edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:55.063517 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1167/2352] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:55.068006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9e59d-bf3d-4f94-8119-1abd2d46adb5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:55.079515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9e59d-bf3d-4f94-8119-1abd2d46adb5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:55.084332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90a91b-04f1-4af8-863e-3f15f470fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:55.085193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90a91b-04f1-4af8-863e-3f15f470fcdd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:55.085476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90a91b-04f1-4af8-863e-3f15f470fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:55.085945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90a91b-04f1-4af8-863e-3f15f470fcdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:55.086683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90a91b-04f1-4af8-863e-3f15f470fcdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:14:55.087503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90a91b-04f1-4af8-863e-3f15f470fcdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:55.088596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90a91b-04f1-4af8-863e-3f15f470fcdd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:55.102341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1186/2353] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:14:55.107388 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a83b6b-7adb-45e0-8b27-c644e790edb0 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:55.117334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a83b6b-7adb-45e0-8b27-c644e790edb0 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:55.121983 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce277227-5934-44ad-9d6f-d5912f699cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:55.122586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce277227-5934-44ad-9d6f-d5912f699cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:55.122865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce277227-5934-44ad-9d6f-d5912f699cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:55.123138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce277227-5934-44ad-9d6f-d5912f699cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:55.123794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce277227-5934-44ad-9d6f-d5912f699cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:55.125780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce277227-5934-44ad-9d6f-d5912f699cd9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:55.140441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:55.248264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1168/2354] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:14:55 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:14:55.252490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90a91b-04f1-4af8-863e-3f15f470fcdd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:55.264112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90a91b-04f1-4af8-863e-3f15f470fcdd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:55.329820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0b822-54f7-44ff-b8fe-129e5cc39171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:55.330470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0b822-54f7-44ff-b8fe-129e5cc39171 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:55.330777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0b822-54f7-44ff-b8fe-129e5cc39171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:55.331057 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0b822-54f7-44ff-b8fe-129e5cc39171 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:55.331804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0b822-54f7-44ff-b8fe-129e5cc39171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:55.333917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0b822-54f7-44ff-b8fe-129e5cc39171 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:55.423911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1187/2355] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:14:55 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:14:55.430303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce277227-5934-44ad-9d6f-d5912f699cd9 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:55.441319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce277227-5934-44ad-9d6f-d5912f699cd9 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:55.451334 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8ae40-03a9-4694-a435-53039eadcc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:55.451959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8ae40-03a9-4694-a435-53039eadcc78 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:55.452692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8ae40-03a9-4694-a435-53039eadcc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:55.452692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8ae40-03a9-4694-a435-53039eadcc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:55.458976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8ae40-03a9-4694-a435-53039eadcc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:55.458976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8ae40-03a9-4694-a435-53039eadcc78 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:55.469760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1169/2356] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:14:55.470726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0b822-54f7-44ff-b8fe-129e5cc39171 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:55.489029 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0b822-54f7-44ff-b8fe-129e5cc39171 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:55.496605 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339bd87-7127-4d17-9b90-3a9138587a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:55.497266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bd87-7127-4d17-9b90-3a9138587a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:55.497549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bd87-7127-4d17-9b90-3a9138587a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:55.497919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bd87-7127-4d17-9b90-3a9138587a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:55.498621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339bd87-7127-4d17-9b90-3a9138587a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:55.500213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339bd87-7127-4d17-9b90-3a9138587a88 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:55.516025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1188/2357] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:14:55.517733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8ae40-03a9-4694-a435-53039eadcc78 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:55.528376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8ae40-03a9-4694-a435-53039eadcc78 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:55.533946 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea78ed-ba12-47a4-8cf6-c69bb10306b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:55.534588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea78ed-ba12-47a4-8cf6-c69bb10306b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:55.534927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea78ed-ba12-47a4-8cf6-c69bb10306b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:55.536164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea78ed-ba12-47a4-8cf6-c69bb10306b2 admin admin] PATH_INFO: `/v3/projects/dd8e9c069b8141bfa2d5383b0890bc76/users/3ac845392b3342e1b71a3b8aaad851e2/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:55.551340 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea78ed-ba12-47a4-8cf6-c69bb10306b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8e9c069b8141bfa2d5383b0890bc76, user_id=3ac845392b3342e1b71a3b8aaad851e2, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:55.554286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea78ed-ba12-47a4-8cf6-c69bb10306b2 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:55.653196 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1170/2358] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:14:55 2022] PUT /identity/v3/projects/dd8e9c069b8141bfa2d5383b0890bc76/users/3ac845392b3342e1b71a3b8aaad851e2/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:14:55.658660 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633b300-6537-461c-8543-21e558b339ea None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:55.658965 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633b300-6537-461c-8543-21e558b339ea None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:55.659240 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633b300-6537-461c-8543-21e558b339ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:55.681666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3633b300-6537-461c-8543-21e558b339ea None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:55.682872 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3633b300-6537-461c-8543-21e558b339ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:55.742098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1189/2359] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:55.751913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea78ed-ba12-47a4-8cf6-c69bb10306b2 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:55.753654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-beea78ed-ba12-47a4-8cf6-c69bb10306b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:55.816540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea78ed-ba12-47a4-8cf6-c69bb10306b2 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:55.820628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c6c1-0b68-480a-beef-d0a26108dac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:55.821289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c6c1-0b68-480a-beef-d0a26108dac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:55.821572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c6c1-0b68-480a-beef-d0a26108dac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:55.821847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c6c1-0b68-480a-beef-d0a26108dac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:55.837101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6c6c1-0b68-480a-beef-d0a26108dac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:55.837418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6c6c1-0b68-480a-beef-d0a26108dac4 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:55.848350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1171/2360] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:56.048169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a09e6-211e-4e74-b2cb-9f914f3b194c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:56.048733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a09e6-211e-4e74-b2cb-9f914f3b194c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:56.048733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a09e6-211e-4e74-b2cb-9f914f3b194c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:56.050338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1190/2361] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:14:56.056096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf2b2e-0a0c-4f74-b946-793104416450 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:56.056457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf2b2e-0a0c-4f74-b946-793104416450 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:56.060743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf2b2e-0a0c-4f74-b946-793104416450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:56.078191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-91bf2b2e-0a0c-4f74-b946-793104416450 None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:56.079582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-91bf2b2e-0a0c-4f74-b946-793104416450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:56.154110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1172/2362] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:14:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:56.165596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a09e6-211e-4e74-b2cb-9f914f3b194c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:56.168654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-615a09e6-211e-4e74-b2cb-9f914f3b194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:56.229192 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a09e6-211e-4e74-b2cb-9f914f3b194c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:56.232763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf89bb-757a-45c1-a9ca-7ab9e2b7cb64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18138af1ea504faca84b0cc2034ddd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:56.233388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf89bb-757a-45c1-a9ca-7ab9e2b7cb64 service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:56.233669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf89bb-757a-45c1-a9ca-7ab9e2b7cb64 service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:56.233941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf89bb-757a-45c1-a9ca-7ab9e2b7cb64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:56.244513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf89bb-757a-45c1-a9ca-7ab9e2b7cb64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:56.245957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf89bb-757a-45c1-a9ca-7ab9e2b7cb64 service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:56.250905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:56.258860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1191/2363] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:56.494165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05e8a-bc8b-43a2-b22a-4e422bd65254 None None] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:56.494452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05e8a-bc8b-43a2-b22a-4e422bd65254 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:56.494730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05e8a-bc8b-43a2-b22a-4e422bd65254 None None] PATH_INFO: `/` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:56.496121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1173/2364] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:14:56.501036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873ac5b-687c-47d1-ae15-94ffcfc04493 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:56.501321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873ac5b-687c-47d1-ae15-94ffcfc04493 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:56.501596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873ac5b-687c-47d1-ae15-94ffcfc04493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:56.522542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2873ac5b-687c-47d1-ae15-94ffcfc04493 None None] MFA Rules not processed for user `0116171a83f5444d91ce0ea2439a9bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:56.523334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2873ac5b-687c-47d1-ae15-94ffcfc04493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:56.530612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1192/2365] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:14:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:56.556166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c05e8a-bc8b-43a2-b22a-4e422bd65254 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:56.558053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-27c05e8a-bc8b-43a2-b22a-4e422bd65254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:56.574371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c05e8a-bc8b-43a2-b22a-4e422bd65254 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:56.578523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cf0fa-4126-4c77-aef8-3932b4111329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:56.579253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf0fa-4126-4c77-aef8-3932b4111329 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:56.579640 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf0fa-4126-4c77-aef8-3932b4111329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:56.580121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf0fa-4126-4c77-aef8-3932b4111329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:56.588434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cf0fa-4126-4c77-aef8-3932b4111329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:56.589649 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cf0fa-4126-4c77-aef8-3932b4111329 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:56.600420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1174/2366] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:14:56.684652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b15b-5744-4f91-b506-fce6723f1e91 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:56.684979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b15b-5744-4f91-b506-fce6723f1e91 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:56.685257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b15b-5744-4f91-b506-fce6723f1e91 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:56.686620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1193/2367] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 28 18:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 18:14:56.692089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cc687-767d-447d-a69a-2f8bccfac0e8 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:56.692540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cc687-767d-447d-a69a-2f8bccfac0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:56.692638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cc687-767d-447d-a69a-2f8bccfac0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:56.712539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-dc8cc687-767d-447d-a69a-2f8bccfac0e8 None None] MFA Rules not processed for user `cb85b3e1dc464438ac007c1b09ea7fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:14:56.713783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-dc8cc687-767d-447d-a69a-2f8bccfac0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:14:56.723377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1175/2368] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 28 18:14:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:14:56.734241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b15b-5744-4f91-b506-fce6723f1e91 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:14:56.745695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b15b-5744-4f91-b506-fce6723f1e91 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:14:56.749676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612ae96-db62-438b-8eea-a262c803b294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:14:56.750283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612ae96-db62-438b-8eea-a262c803b294 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:14:56.750568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612ae96-db62-438b-8eea-a262c803b294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:14:56.750846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612ae96-db62-438b-8eea-a262c803b294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:14:56.761447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612ae96-db62-438b-8eea-a262c803b294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:14:56.762915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612ae96-db62-438b-8eea-a262c803b294 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:14:56.774145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1194/2369] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:14:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:02.850815 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e526c9a-eaf5-47dd-92a6-3e5014b492c7 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:02.851217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e526c9a-eaf5-47dd-92a6-3e5014b492c7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:02.851383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e526c9a-eaf5-47dd-92a6-3e5014b492c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:02.889220 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-8e526c9a-eaf5-47dd-92a6-3e5014b492c7 None None] MFA Rules not processed for user `3ac845392b3342e1b71a3b8aaad851e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:02.890425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8e526c9a-eaf5-47dd-92a6-3e5014b492c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:02.915883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:02.964720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1176/2370] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:02.969725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612ae96-db62-438b-8eea-a262c803b294 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:02.980030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612ae96-db62-438b-8eea-a262c803b294 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:02.984707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53de383-b1a1-4177-b116-78aeae9b28ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:02.985352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53de383-b1a1-4177-b116-78aeae9b28ad admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:02.985724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53de383-b1a1-4177-b116-78aeae9b28ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:02.986040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53de383-b1a1-4177-b116-78aeae9b28ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:02.986709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53de383-b1a1-4177-b116-78aeae9b28ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:02.988724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53de383-b1a1-4177-b116-78aeae9b28ad admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:03.041736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d8d95-1882-4a66-8545-7b45cecc8934 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.042026 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d8d95-1882-4a66-8545-7b45cecc8934 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.042303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d8d95-1882-4a66-8545-7b45cecc8934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.072367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a22d8d95-1882-4a66-8545-7b45cecc8934 None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:03.073604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a22d8d95-1882-4a66-8545-7b45cecc8934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:03.112844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1195/2371] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:02 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:03.117334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53de383-b1a1-4177-b116-78aeae9b28ad admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:03.154638 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1177/2372] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 28 18:15:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:03.173294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d8d95-1882-4a66-8545-7b45cecc8934 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:03.173294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a22d8d95-1882-4a66-8545-7b45cecc8934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:03.226670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53de383-b1a1-4177-b116-78aeae9b28ad admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:03.237152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71150a8a-49c1-4339-a816-217cea6ef36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:03.238094 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71150a8a-49c1-4339-a816-217cea6ef36f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.238682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71150a8a-49c1-4339-a816-217cea6ef36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.239286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71150a8a-49c1-4339-a816-217cea6ef36f admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.240254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71150a8a-49c1-4339-a816-217cea6ef36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:03.253145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71150a8a-49c1-4339-a816-217cea6ef36f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:03.259776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d8d95-1882-4a66-8545-7b45cecc8934 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:03.342474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df3060-6e8a-422a-8ab4-6cdda5fa7da8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:03.343782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df3060-6e8a-422a-8ab4-6cdda5fa7da8 service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.344143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df3060-6e8a-422a-8ab4-6cdda5fa7da8 service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.344421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df3060-6e8a-422a-8ab4-6cdda5fa7da8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.357641 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:03.362787 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1196/2373] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:03 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:03.368164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71150a8a-49c1-4339-a816-217cea6ef36f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:03.379928 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71150a8a-49c1-4339-a816-217cea6ef36f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:03.386576 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46157a33-0c42-446a-b5f0-5abd299896f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:03.387241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46157a33-0c42-446a-b5f0-5abd299896f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.387540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46157a33-0c42-446a-b5f0-5abd299896f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.387818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46157a33-0c42-446a-b5f0-5abd299896f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.388528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46157a33-0c42-446a-b5f0-5abd299896f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:03.390180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46157a33-0c42-446a-b5f0-5abd299896f0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:03.409269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1197/2374] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:03.410767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46157a33-0c42-446a-b5f0-5abd299896f0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:03.422660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df3060-6e8a-422a-8ab4-6cdda5fa7da8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:03.423414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46157a33-0c42-446a-b5f0-5abd299896f0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:03.425042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df3060-6e8a-422a-8ab4-6cdda5fa7da8 service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:03.428721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189af8ec-87d1-4eb9-acff-d79200bc9737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:03.430113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189af8ec-87d1-4eb9-acff-d79200bc9737 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.430459 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189af8ec-87d1-4eb9-acff-d79200bc9737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.430841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189af8ec-87d1-4eb9-acff-d79200bc9737 admin admin] PATH_INFO: `/v3/projects/a838fb25b3274a8988182ed0e3984702/users/4e80eedec4424f7c99694b3a788e8415/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.435768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1178/2375] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:03.453968 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189af8ec-87d1-4eb9-acff-d79200bc9737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a838fb25b3274a8988182ed0e3984702, user_id=4e80eedec4424f7c99694b3a788e8415, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:03.461946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189af8ec-87d1-4eb9-acff-d79200bc9737 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:03.574525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1198/2376] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:03 2022] PUT /identity/v3/projects/a838fb25b3274a8988182ed0e3984702/users/4e80eedec4424f7c99694b3a788e8415/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:03.578380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df3060-6e8a-422a-8ab4-6cdda5fa7da8 service swift] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:03.590691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df3060-6e8a-422a-8ab4-6cdda5fa7da8 service swift] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:03.656447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cba5e-cf20-45aa-8270-8f430ee5cd4c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.656931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cba5e-cf20-45aa-8270-8f430ee5cd4c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.657145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cba5e-cf20-45aa-8270-8f430ee5cd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.669117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4cae9-90c4-4aed-81da-d0ed531a4525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:03.669754 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4cae9-90c4-4aed-81da-d0ed531a4525 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.670035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4cae9-90c4-4aed-81da-d0ed531a4525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.670310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4cae9-90c4-4aed-81da-d0ed531a4525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.671568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4cae9-90c4-4aed-81da-d0ed531a4525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:03.675602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4cae9-90c4-4aed-81da-d0ed531a4525 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:03.682760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-391cba5e-cf20-45aa-8270-8f430ee5cd4c None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:03.684180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-391cba5e-cf20-45aa-8270-8f430ee5cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:03.688905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1179/2377] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:03.693135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4cae9-90c4-4aed-81da-d0ed531a4525 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:03.704447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4cae9-90c4-4aed-81da-d0ed531a4525 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:03.713873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aed788-eaae-4907-be83-3892ccdead18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:03.714733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aed788-eaae-4907-be83-3892ccdead18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.715085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aed788-eaae-4907-be83-3892ccdead18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.715368 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aed788-eaae-4907-be83-3892ccdead18 admin admin] PATH_INFO: `/v3/projects/a838fb25b3274a8988182ed0e3984702/users/4e80eedec4424f7c99694b3a788e8415/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.718014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aed788-eaae-4907-be83-3892ccdead18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a838fb25b3274a8988182ed0e3984702, user_id=4e80eedec4424f7c99694b3a788e8415, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:03.721143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aed788-eaae-4907-be83-3892ccdead18 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:03.736550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1180/2378] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:03 2022] PUT /identity/v3/projects/a838fb25b3274a8988182ed0e3984702/users/4e80eedec4424f7c99694b3a788e8415/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:03.754049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1199/2379] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:15:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:03.767439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aed788-eaae-4907-be83-3892ccdead18 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:03.848758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aed788-eaae-4907-be83-3892ccdead18 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:03.860932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858b5ec-7b3b-416b-b4cb-a0de0d50cc66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:03.860932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b5ec-7b3b-416b-b4cb-a0de0d50cc66 service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:03.860932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b5ec-7b3b-416b-b4cb-a0de0d50cc66 service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:03.860932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b5ec-7b3b-416b-b4cb-a0de0d50cc66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:03.912297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:03.943895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858b5ec-7b3b-416b-b4cb-a0de0d50cc66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:03.945755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858b5ec-7b3b-416b-b4cb-a0de0d50cc66 service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:03.973526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1181/2380] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:13.017428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cba5e-cf20-45aa-8270-8f430ee5cd4c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:13.019556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-391cba5e-cf20-45aa-8270-8f430ee5cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:13.063778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:13.228534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cba5e-cf20-45aa-8270-8f430ee5cd4c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:13.423939 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:13.425997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:13.426358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:13.426716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:13.437336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:13.498250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:13.503867 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:13.532871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1200/2381] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:13.639799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4944af-babb-4a3d-b669-5fd9e8952a57 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:13.641024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4944af-babb-4a3d-b669-5fd9e8952a57 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:13.641024 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4944af-babb-4a3d-b669-5fd9e8952a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:13.688039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-1b4944af-babb-4a3d-b669-5fd9e8952a57 None None] MFA Rules not processed for user `4e80eedec4424f7c99694b3a788e8415`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:13.689726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1b4944af-babb-4a3d-b669-5fd9e8952a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:13.794953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1182/2382] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:13.810466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:13.812293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:13.922745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47463cb-c6f6-4fe3-9bf6-be80281bf77c service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:13.932434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233c905-250e-4ba8-aede-410bb2f35180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:13.933691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233c905-250e-4ba8-aede-410bb2f35180 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:13.934136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233c905-250e-4ba8-aede-410bb2f35180 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:13.934562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233c905-250e-4ba8-aede-410bb2f35180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:13.991870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:14.041493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233c905-250e-4ba8-aede-410bb2f35180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:14.045085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233c905-250e-4ba8-aede-410bb2f35180 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:14.076221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1201/2383] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:19.526213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955a464-fd9e-4d7e-aacf-ed0e03c5ee20 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:19.526689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955a464-fd9e-4d7e-aacf-ed0e03c5ee20 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:19.526789 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955a464-fd9e-4d7e-aacf-ed0e03c5ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:19.578050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-0955a464-fd9e-4d7e-aacf-ed0e03c5ee20 None None] MFA Rules not processed for user `3ac845392b3342e1b71a3b8aaad851e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:19.579502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0955a464-fd9e-4d7e-aacf-ed0e03c5ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:19.588575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1183/2384] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:20.196926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233c905-250e-4ba8-aede-410bb2f35180 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:20.354956 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233c905-250e-4ba8-aede-410bb2f35180 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:20.372714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108173b5-0808-446d-b340-27d8d81f85ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:20.373646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108173b5-0808-446d-b340-27d8d81f85ec service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:20.374148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108173b5-0808-446d-b340-27d8d81f85ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:20.374709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108173b5-0808-446d-b340-27d8d81f85ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:20.379835 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-108173b5-0808-446d-b340-27d8d81f85ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:20.592543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108173b5-0808-446d-b340-27d8d81f85ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:20.595280 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108173b5-0808-446d-b340-27d8d81f85ec service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:20.611045 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1202/2385] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:15:22.397822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955a464-fd9e-4d7e-aacf-ed0e03c5ee20 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:22.399337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0955a464-fd9e-4d7e-aacf-ed0e03c5ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:22.418749 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955a464-fd9e-4d7e-aacf-ed0e03c5ee20 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:22.425136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:22.426593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:22.426966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:22.427470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] PATH_INFO: `/v3/users/b7f2bda7559e408183484833bf8935ca` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:22.431441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f2bda7559e408183484833bf8935ca)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:22.434097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:22.656149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f2bda7559e408183484833bf8935ca'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:22.656831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f2bda7559e408183484833bf8935ca'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:22.727379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f2bda7559e408183484833bf8935ca'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:22.729878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f2bda7559e408183484833bf8935ca'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:22.754318 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f2bda7559e408183484833bf8935ca'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:22.778611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1184/2386] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:22 2022] DELETE /identity/v3/users/b7f2bda7559e408183484833bf8935ca => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:23.186587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108173b5-0808-446d-b340-27d8d81f85ec service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:23.202234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108173b5-0808-446d-b340-27d8d81f85ec service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:23.321015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:23.321739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:23.322161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:23.322444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] PATH_INFO: `/v3/projects/208f9a2169764bacb536951f6a049229` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:23.323731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] RBAC: Authorizing `identity:delete_project(project_id=208f9a2169764bacb536951f6a049229)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:23.325907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:23.462367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:23.475181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208f9a2169764bacb536951f6a049229', 'request_id': 'req-25e5da97-23f9-40ef-9aed-eda98bb7420e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:23.560322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208f9a2169764bacb536951f6a049229', 'request_id': 'req-25e5da97-23f9-40ef-9aed-eda98bb7420e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:23.567842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208f9a2169764bacb536951f6a049229', 'request_id': 'req-25e5da97-23f9-40ef-9aed-eda98bb7420e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:23.588107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] The token cache is being invalidate because project 208f9a2169764bacb536951f6a049229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:23.590446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:23.591738 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:23.602794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:23.605165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:23.612889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1203/2387] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:23 2022] DELETE /identity/v3/projects/208f9a2169764bacb536951f6a049229 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:23.641256 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1051e2-df29-4dd6-91f8-f3aed90ea1dd admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:23.664279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:23.714010 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:23.714663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:23.714947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:23.715221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] PATH_INFO: `/v3/users/69b002cc0f9942b7be08ad6b003284be` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:23.716914 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b002cc0f9942b7be08ad6b003284be)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:23.719450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:23.936126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b002cc0f9942b7be08ad6b003284be'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:23.937455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b002cc0f9942b7be08ad6b003284be'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:24.012467 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b002cc0f9942b7be08ad6b003284be'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:24.013426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b002cc0f9942b7be08ad6b003284be'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:24.036950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b002cc0f9942b7be08ad6b003284be'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:24.052879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1185/2388] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:23 2022] DELETE /identity/v3/users/69b002cc0f9942b7be08ad6b003284be => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:25.167389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:25.169496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:25.215333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5da97-23f9-40ef-9aed-eda98bb7420e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:25.371130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:25.372247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:25.372247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:25.372709 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] PATH_INFO: `/v3/projects/141e25f9fa7644cc966f75e005ed5ed1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:25.375239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141e25f9fa7644cc966f75e005ed5ed1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:25.378045 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:25.954399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141e25f9fa7644cc966f75e005ed5ed1', 'request_id': 'req-d6a3b721-a604-40c0-8e6b-c084316c5813'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:26.074243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141e25f9fa7644cc966f75e005ed5ed1', 'request_id': 'req-d6a3b721-a604-40c0-8e6b-c084316c5813'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:26.081828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141e25f9fa7644cc966f75e005ed5ed1', 'request_id': 'req-d6a3b721-a604-40c0-8e6b-c084316c5813'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:26.103555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] The token cache is being invalidate because project 141e25f9fa7644cc966f75e005ed5ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:26.103935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:26.105187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d6a3b721-a604-40c0-8e6b-c084316c5813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:26.118868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1204/2389] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:25 2022] DELETE /identity/v3/projects/141e25f9fa7644cc966f75e005ed5ed1 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:27.432062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:27.432062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:27.445986 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f679b-6c1b-415e-82f9-385b94d35c5c admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:27.540621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:27.541631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:27.542158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:27.542493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] PATH_INFO: `/v3/users/7b48b352a5514bab8651977f5f9ef040` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:27.543894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b48b352a5514bab8651977f5f9ef040)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:27.546020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:27.555075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa9b6-9ba8-4e98-98cc-9c9ba02d5781 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:27.555907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa9b6-9ba8-4e98-98cc-9c9ba02d5781 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:27.556191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa9b6-9ba8-4e98-98cc-9c9ba02d5781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:27.577850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-be1aa9b6-9ba8-4e98-98cc-9c9ba02d5781 None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:27.579143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-be1aa9b6-9ba8-4e98-98cc-9c9ba02d5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:27.669544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:27.679286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1205/2390] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 28 18:15:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:27.692590 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aa9b6-9ba8-4e98-98cc-9c9ba02d5781 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:27.695453 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-be1aa9b6-9ba8-4e98-98cc-9c9ba02d5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:27.729268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b48b352a5514bab8651977f5f9ef040'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:27.730248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b48b352a5514bab8651977f5f9ef040'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:27.732478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:27.782201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aa9b6-9ba8-4e98-98cc-9c9ba02d5781 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:27.787804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac7829-c534-4963-a544-17d7f6895bdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:27.790788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac7829-c534-4963-a544-17d7f6895bdf service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:27.790788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac7829-c534-4963-a544-17d7f6895bdf service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:27.790788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac7829-c534-4963-a544-17d7f6895bdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:27.801031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac7829-c534-4963-a544-17d7f6895bdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:27.802636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac7829-c534-4963-a544-17d7f6895bdf service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:27.811375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1206/2391] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:15:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 18:15:27.839715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b48b352a5514bab8651977f5f9ef040'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:27.846486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b48b352a5514bab8651977f5f9ef040'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:27.855614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-32365f9c-7bae-4e1e-8a79-1dd42368b6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b48b352a5514bab8651977f5f9ef040'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:27.868255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1186/2392] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:27 2022] DELETE /identity/v3/users/7b48b352a5514bab8651977f5f9ef040 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:28.247051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac7829-c534-4963-a544-17d7f6895bdf service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:28.248511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-13ac7829-c534-4963-a544-17d7f6895bdf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:28.264093 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac7829-c534-4963-a544-17d7f6895bdf service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:28.334723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:28.335367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:28.335674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:28.335946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] PATH_INFO: `/v3/projects/0a6a212dd48d442e8cf62f4fcd8268bc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:28.337126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6a212dd48d442e8cf62f4fcd8268bc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:28.339091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:28.462861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6a212dd48d442e8cf62f4fcd8268bc', 'request_id': 'req-990337ae-37e6-448e-a915-996592ece95a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:28.618421 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6a212dd48d442e8cf62f4fcd8268bc', 'request_id': 'req-990337ae-37e6-448e-a915-996592ece95a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:28.628997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6a212dd48d442e8cf62f4fcd8268bc', 'request_id': 'req-990337ae-37e6-448e-a915-996592ece95a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:28.638419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] The token cache is being invalidate because project 0a6a212dd48d442e8cf62f4fcd8268bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:28.638706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:28.639364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-990337ae-37e6-448e-a915-996592ece95a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:28.640915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1207/2393] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:28 2022] DELETE /identity/v3/projects/0a6a212dd48d442e8cf62f4fcd8268bc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:28.646126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f4a9-717a-445a-b4be-65924e4056a4 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:28.646613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f4a9-717a-445a-b4be-65924e4056a4 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:28.646710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f4a9-717a-445a-b4be-65924e4056a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:28.678794 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-1ac7f4a9-717a-445a-b4be-65924e4056a4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:28.680000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1ac7f4a9-717a-445a-b4be-65924e4056a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:28.746148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1187/2394] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:28.755094 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9c95-8ace-4308-b559-798c4a7ad02c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:28.755323 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9c95-8ace-4308-b559-798c4a7ad02c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:28.755606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9c95-8ace-4308-b559-798c4a7ad02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:28.777724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-68bc9c95-8ace-4308-b559-798c4a7ad02c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:28.778932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-68bc9c95-8ace-4308-b559-798c4a7ad02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:28.786938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1208/2395] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:28.791332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f4a9-717a-445a-b4be-65924e4056a4 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:28.801103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f4a9-717a-445a-b4be-65924e4056a4 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:28.806722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4576a-8b20-4caa-ba4e-2c5c08570c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:28.807447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4576a-8b20-4caa-ba4e-2c5c08570c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:28.807733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4576a-8b20-4caa-ba4e-2c5c08570c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:28.808052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4576a-8b20-4caa-ba4e-2c5c08570c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:28.809019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4576a-8b20-4caa-ba4e-2c5c08570c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:28.812714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4576a-8b20-4caa-ba4e-2c5c08570c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:28.812714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4576a-8b20-4caa-ba4e-2c5c08570c4f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:28.825865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1188/2396] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:15:28.833721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9c95-8ace-4308-b559-798c4a7ad02c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:28.844886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9c95-8ace-4308-b559-798c4a7ad02c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:28.850314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ebaf3-35b1-433f-9a97-facbda29bd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:28.851076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ebaf3-35b1-433f-9a97-facbda29bd09 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:28.851506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ebaf3-35b1-433f-9a97-facbda29bd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:28.851786 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ebaf3-35b1-433f-9a97-facbda29bd09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:28.852454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ebaf3-35b1-433f-9a97-facbda29bd09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:28.854555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ebaf3-35b1-433f-9a97-facbda29bd09 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:28.869471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:28.969137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1209/2397] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:28 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:28.973395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4576a-8b20-4caa-ba4e-2c5c08570c4f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:28.986325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4576a-8b20-4caa-ba4e-2c5c08570c4f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:29.055653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407564d-bc80-4c5d-b17f-2ca1697f4b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:29.056212 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407564d-bc80-4c5d-b17f-2ca1697f4b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.056500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407564d-bc80-4c5d-b17f-2ca1697f4b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.056823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407564d-bc80-4c5d-b17f-2ca1697f4b31 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.057514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407564d-bc80-4c5d-b17f-2ca1697f4b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:29.059555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407564d-bc80-4c5d-b17f-2ca1697f4b31 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:29.203019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1189/2398] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:28 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:29.209940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ebaf3-35b1-433f-9a97-facbda29bd09 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:29.220980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ebaf3-35b1-433f-9a97-facbda29bd09 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:29.228011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd9289-a094-42da-8092-82766750b877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:29.229712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9289-a094-42da-8092-82766750b877 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.229712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9289-a094-42da-8092-82766750b877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.229712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9289-a094-42da-8092-82766750b877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.230638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd9289-a094-42da-8092-82766750b877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:29.232354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd9289-a094-42da-8092-82766750b877 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:29.244549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1210/2399] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:29.248566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407564d-bc80-4c5d-b17f-2ca1697f4b31 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:29.259562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407564d-bc80-4c5d-b17f-2ca1697f4b31 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:29.264643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b21bfc-f39e-40cf-8855-d7721f3e9cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:29.265317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b21bfc-f39e-40cf-8855-d7721f3e9cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.265596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b21bfc-f39e-40cf-8855-d7721f3e9cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.265868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b21bfc-f39e-40cf-8855-d7721f3e9cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.266589 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b21bfc-f39e-40cf-8855-d7721f3e9cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:29.268247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b21bfc-f39e-40cf-8855-d7721f3e9cf0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:29.280180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1190/2400] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:29.284752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd9289-a094-42da-8092-82766750b877 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:29.296450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd9289-a094-42da-8092-82766750b877 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:29.301422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc40d8-5075-44ed-a94f-455372870c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:29.302104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc40d8-5075-44ed-a94f-455372870c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.302410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc40d8-5075-44ed-a94f-455372870c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.302684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc40d8-5075-44ed-a94f-455372870c05 admin admin] PATH_INFO: `/v3/projects/9676d02e2709487e8b42bd33364c2109/users/2eeb3c2d5b5a41e4b1cbbc89d839694b/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.318216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc40d8-5075-44ed-a94f-455372870c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9676d02e2709487e8b42bd33364c2109, user_id=2eeb3c2d5b5a41e4b1cbbc89d839694b, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:29.322553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc40d8-5075-44ed-a94f-455372870c05 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:29.383027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1211/2401] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:29 2022] PUT /identity/v3/projects/9676d02e2709487e8b42bd33364c2109/users/2eeb3c2d5b5a41e4b1cbbc89d839694b/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:29.394035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4660b-10c5-401f-b999-8cb6b805509c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.394385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4660b-10c5-401f-b999-8cb6b805509c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.394777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4660b-10c5-401f-b999-8cb6b805509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.423416 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-fdd4660b-10c5-401f-b999-8cb6b805509c None None] MFA Rules not processed for user `2eeb3c2d5b5a41e4b1cbbc89d839694b`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:29.424655 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fdd4660b-10c5-401f-b999-8cb6b805509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:29.444482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:29.490671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1191/2402] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:29.501177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc40d8-5075-44ed-a94f-455372870c05 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:29.502916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-98bc40d8-5075-44ed-a94f-455372870c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:29.578659 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc40d8-5075-44ed-a94f-455372870c05 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:29.585173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee46ad-dfaf-4114-b4da-ca3d4c7e3555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:29.585821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee46ad-dfaf-4114-b4da-ca3d4c7e3555 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:29.586105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee46ad-dfaf-4114-b4da-ca3d4c7e3555 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:29.586379 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee46ad-dfaf-4114-b4da-ca3d4c7e3555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:29.595334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee46ad-dfaf-4114-b4da-ca3d4c7e3555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:29.596944 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee46ad-dfaf-4114-b4da-ca3d4c7e3555 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:29.606411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1212/2403] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:30.040017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4660b-10c5-401f-b999-8cb6b805509c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:30.041531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fdd4660b-10c5-401f-b999-8cb6b805509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:30.110133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4660b-10c5-401f-b999-8cb6b805509c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:30.126650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcb591-b916-48d5-a64f-37fb3302d958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:30.126650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcb591-b916-48d5-a64f-37fb3302d958 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:30.126650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcb591-b916-48d5-a64f-37fb3302d958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:30.126650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcb591-b916-48d5-a64f-37fb3302d958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:30.127633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-06fcb591-b916-48d5-a64f-37fb3302d958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:30.205996 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcb591-b916-48d5-a64f-37fb3302d958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:30.207735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcb591-b916-48d5-a64f-37fb3302d958 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:30.219427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1192/2404] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:35.311251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee46ad-dfaf-4114-b4da-ca3d4c7e3555 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:35.313314 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bbee46ad-dfaf-4114-b4da-ca3d4c7e3555 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:35.329077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee46ad-dfaf-4114-b4da-ca3d4c7e3555 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:35.333769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:35.334415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:35.334706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:35.334979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] PATH_INFO: `/v3/users/7388d3603bbd428cabf62a1f46e73929` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:35.336121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7388d3603bbd428cabf62a1f46e73929)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:35.338415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:35.591610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7388d3603bbd428cabf62a1f46e73929'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:35.592540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7388d3603bbd428cabf62a1f46e73929'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:35.599320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7388d3603bbd428cabf62a1f46e73929'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:35.599957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7388d3603bbd428cabf62a1f46e73929'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:35.612312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07aedb1b-0f7a-417d-b861-c0374c2c1bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7388d3603bbd428cabf62a1f46e73929'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:35.748589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1213/2405] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:35 2022] DELETE /identity/v3/users/7388d3603bbd428cabf62a1f46e73929 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:35.984515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcb591-b916-48d5-a64f-37fb3302d958 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:35.995476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcb591-b916-48d5-a64f-37fb3302d958 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:36.059021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:36.059663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.059940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.060218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] PATH_INFO: `/v3/projects/823933265a4542288e573bdc30ec712e` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.061509 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=823933265a4542288e573bdc30ec712e)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:36.063540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:36.076765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:36.232097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823933265a4542288e573bdc30ec712e', 'request_id': 'req-c6ffeb3c-5975-4f17-a375-30e2722f5399'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.237718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823933265a4542288e573bdc30ec712e', 'request_id': 'req-c6ffeb3c-5975-4f17-a375-30e2722f5399'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.314221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823933265a4542288e573bdc30ec712e', 'request_id': 'req-c6ffeb3c-5975-4f17-a375-30e2722f5399'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.326324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] The token cache is being invalidate because project 823933265a4542288e573bdc30ec712e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:36.326616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.327263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.328828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1193/2406] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:35 2022] DELETE /identity/v3/projects/823933265a4542288e573bdc30ec712e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:36.333945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1db8c-62c2-4d93-b474-7a3ae559d23e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.334411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1db8c-62c2-4d93-b474-7a3ae559d23e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.335193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1db8c-62c2-4d93-b474-7a3ae559d23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.345411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:36.345411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:36.358505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a3c1db8c-62c2-4d93-b474-7a3ae559d23e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:36.359733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a3c1db8c-62c2-4d93-b474-7a3ae559d23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:36.368550 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:36.411686 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffeb3c-5975-4f17-a375-30e2722f5399 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:36.416501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:36.417248 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.417536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.417857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] PATH_INFO: `/v3/users/2eeb3c2d5b5a41e4b1cbbc89d839694b` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.419080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eeb3c2d5b5a41e4b1cbbc89d839694b)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:36.421040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1214/2407] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:36.421170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:36.428639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558c0ac-14bc-41f7-8ff2-acc811ee3beb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.428961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558c0ac-14bc-41f7-8ff2-acc811ee3beb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.431378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558c0ac-14bc-41f7-8ff2-acc811ee3beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.448668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5558c0ac-14bc-41f7-8ff2-acc811ee3beb None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:36.449954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5558c0ac-14bc-41f7-8ff2-acc811ee3beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:36.457886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1215/2408] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:36.462595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558c0ac-14bc-41f7-8ff2-acc811ee3beb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:36.471638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558c0ac-14bc-41f7-8ff2-acc811ee3beb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:36.476313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151468-2b73-45d3-bcd9-3f1097b71e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:36.476926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151468-2b73-45d3-bcd9-3f1097b71e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.477207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151468-2b73-45d3-bcd9-3f1097b71e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.477486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151468-2b73-45d3-bcd9-3f1097b71e44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.478161 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151468-2b73-45d3-bcd9-3f1097b71e44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:36.478460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151468-2b73-45d3-bcd9-3f1097b71e44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:36.480032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151468-2b73-45d3-bcd9-3f1097b71e44 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:36.491860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1216/2409] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:15:36.495955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151468-2b73-45d3-bcd9-3f1097b71e44 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:36.505232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151468-2b73-45d3-bcd9-3f1097b71e44 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:36.510911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df2d0-4fee-475f-9221-9f3e26aabfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:36.511496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df2d0-4fee-475f-9221-9f3e26aabfee admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.511777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df2d0-4fee-475f-9221-9f3e26aabfee admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.512042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df2d0-4fee-475f-9221-9f3e26aabfee admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.512687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054df2d0-4fee-475f-9221-9f3e26aabfee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:36.514601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054df2d0-4fee-475f-9221-9f3e26aabfee admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:36.652090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1217/2410] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:36 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:36.653255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df2d0-4fee-475f-9221-9f3e26aabfee admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:36.658286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eeb3c2d5b5a41e4b1cbbc89d839694b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.659531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eeb3c2d5b5a41e4b1cbbc89d839694b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.717916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df2d0-4fee-475f-9221-9f3e26aabfee admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:36.722759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96fd1d-3de4-41dc-a329-d7e7a1b58206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:36.723412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96fd1d-3de4-41dc-a329-d7e7a1b58206 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.723695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96fd1d-3de4-41dc-a329-d7e7a1b58206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.723971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96fd1d-3de4-41dc-a329-d7e7a1b58206 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.724642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96fd1d-3de4-41dc-a329-d7e7a1b58206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:36.726631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96fd1d-3de4-41dc-a329-d7e7a1b58206 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:36.737168 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eeb3c2d5b5a41e4b1cbbc89d839694b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.738115 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eeb3c2d5b5a41e4b1cbbc89d839694b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.750860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-8bfc16a8-2114-4f43-b59f-ebf2c353bd62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eeb3c2d5b5a41e4b1cbbc89d839694b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:36.763949 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1194/2411] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:36 2022] DELETE /identity/v3/users/2eeb3c2d5b5a41e4b1cbbc89d839694b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:36.768005 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191b0f-4cf8-457a-9bce-a096eb1edb07 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.768292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191b0f-4cf8-457a-9bce-a096eb1edb07 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.768569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191b0f-4cf8-457a-9bce-a096eb1edb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.787368 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-fb191b0f-4cf8-457a-9bce-a096eb1edb07 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:36.788583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fb191b0f-4cf8-457a-9bce-a096eb1edb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:36.805919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:36.849126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1195/2412] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:36.858732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb191b0f-4cf8-457a-9bce-a096eb1edb07 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:36.860089 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fb191b0f-4cf8-457a-9bce-a096eb1edb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:36.882139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1218/2413] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:36 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:36.886208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96fd1d-3de4-41dc-a329-d7e7a1b58206 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:36.890418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ea96fd1d-3de4-41dc-a329-d7e7a1b58206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:36.913652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96fd1d-3de4-41dc-a329-d7e7a1b58206 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:36.919333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6456e2-9934-471c-8995-b42c2ce55adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:36.919578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6456e2-9934-471c-8995-b42c2ce55adb admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.919890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6456e2-9934-471c-8995-b42c2ce55adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.920367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6456e2-9934-471c-8995-b42c2ce55adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.921032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6456e2-9934-471c-8995-b42c2ce55adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:36.922650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb191b0f-4cf8-457a-9bce-a096eb1edb07 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:36.922899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6456e2-9934-471c-8995-b42c2ce55adb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:36.926354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831541b7-aca6-4134-ae4b-8b734ce0d9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:36.926968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831541b7-aca6-4134-ae4b-8b734ce0d9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.927328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831541b7-aca6-4134-ae4b-8b734ce0d9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.927605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831541b7-aca6-4134-ae4b-8b734ce0d9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.937276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1219/2414] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:36.942025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831541b7-aca6-4134-ae4b-8b734ce0d9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:36.942495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6456e2-9934-471c-8995-b42c2ce55adb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:36.942593 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831541b7-aca6-4134-ae4b-8b734ce0d9e0 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:36.953484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6456e2-9934-471c-8995-b42c2ce55adb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:36.961608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1196/2415] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:15:36.961933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1a9e1-2760-4734-9b80-dcbe48b63294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:36.961933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a9e1-2760-4734-9b80-dcbe48b63294 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:36.961933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a9e1-2760-4734-9b80-dcbe48b63294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:36.961933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a9e1-2760-4734-9b80-dcbe48b63294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:36.962283 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1a9e1-2760-4734-9b80-dcbe48b63294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:36.962820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1a9e1-2760-4734-9b80-dcbe48b63294 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:36.974800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1220/2416] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:36.978816 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831541b7-aca6-4134-ae4b-8b734ce0d9e0 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:36.990281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831541b7-aca6-4134-ae4b-8b734ce0d9e0 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:36.998516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c4d84-db96-4ac5-88cd-2fd1a13404db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:36.999443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c4d84-db96-4ac5-88cd-2fd1a13404db admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:37.000132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c4d84-db96-4ac5-88cd-2fd1a13404db admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:37.000662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c4d84-db96-4ac5-88cd-2fd1a13404db admin admin] PATH_INFO: `/v3/projects/73b328506d114aa1ae7506da398c1be3/users/3f973a3a9b4041c4a359cebd1798b851/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:37.020697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c4d84-db96-4ac5-88cd-2fd1a13404db admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b328506d114aa1ae7506da398c1be3, user_id=3f973a3a9b4041c4a359cebd1798b851, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:37.025091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c4d84-db96-4ac5-88cd-2fd1a13404db admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:37.185166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1197/2417] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:36 2022] PUT /identity/v3/projects/73b328506d114aa1ae7506da398c1be3/users/3f973a3a9b4041c4a359cebd1798b851/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:37.197428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5adc1-5b5d-48da-be17-d9bb99a4437c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:37.197741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5adc1-5b5d-48da-be17-d9bb99a4437c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:37.197995 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5adc1-5b5d-48da-be17-d9bb99a4437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:37.245884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5eb5adc1-5b5d-48da-be17-d9bb99a4437c None None] MFA Rules not processed for user `3f973a3a9b4041c4a359cebd1798b851`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:37.250572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5eb5adc1-5b5d-48da-be17-d9bb99a4437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:37.280039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:37.318468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1221/2418] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:37.323491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c4d84-db96-4ac5-88cd-2fd1a13404db admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:37.388239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c4d84-db96-4ac5-88cd-2fd1a13404db admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:37.393179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72d7df-e6ae-463f-8837-6351bb0c8708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:37.393798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72d7df-e6ae-463f-8837-6351bb0c8708 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:37.394078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72d7df-e6ae-463f-8837-6351bb0c8708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:37.394353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72d7df-e6ae-463f-8837-6351bb0c8708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:37.395021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72d7df-e6ae-463f-8837-6351bb0c8708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:37.396955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72d7df-e6ae-463f-8837-6351bb0c8708 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:37.503919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1198/2419] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:37 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:37.507938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5adc1-5b5d-48da-be17-d9bb99a4437c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:37.519727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5adc1-5b5d-48da-be17-d9bb99a4437c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:37.579186 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72d7df-e6ae-463f-8837-6351bb0c8708 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:37.585542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ff72d7df-e6ae-463f-8837-6351bb0c8708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:37.598047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbfcca-f5be-4ff0-9169-27858755126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:37.599121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbfcca-f5be-4ff0-9169-27858755126c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:37.600125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbfcca-f5be-4ff0-9169-27858755126c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:37.600311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbfcca-f5be-4ff0-9169-27858755126c admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:37.606701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbfcca-f5be-4ff0-9169-27858755126c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:37.610790 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbfcca-f5be-4ff0-9169-27858755126c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:37.626460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:37.666021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72d7df-e6ae-463f-8837-6351bb0c8708 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:37.670907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:37.671538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:37.671820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:37.672097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] PATH_INFO: `/v3/projects/9676d02e2709487e8b42bd33364c2109` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:37.673287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9676d02e2709487e8b42bd33364c2109)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:37.675207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:37.691377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1222/2420] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:37 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:37.699142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbfcca-f5be-4ff0-9169-27858755126c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:37.704825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbfcca-f5be-4ff0-9169-27858755126c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:37.709369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdf763-b822-4aa1-bfe2-9ad182935311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:37.710533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdf763-b822-4aa1-bfe2-9ad182935311 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:37.710850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdf763-b822-4aa1-bfe2-9ad182935311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:37.711159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdf763-b822-4aa1-bfe2-9ad182935311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:37.711982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdf763-b822-4aa1-bfe2-9ad182935311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:37.713529 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdf763-b822-4aa1-bfe2-9ad182935311 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:37.724358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1223/2421] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:37.730344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdf763-b822-4aa1-bfe2-9ad182935311 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:37.739982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdf763-b822-4aa1-bfe2-9ad182935311 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:37.744611 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232f6f7-9991-4387-9432-e5fe65e1ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:37.745338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f6f7-9991-4387-9432-e5fe65e1ebdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:37.745658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f6f7-9991-4387-9432-e5fe65e1ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:37.745959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f6f7-9991-4387-9432-e5fe65e1ebdf admin admin] PATH_INFO: `/v3/projects/5ee52b56bb444f6c8f4f5cd369e81689/users/cf7364b66a0549d48f77c1dd4c63d317/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:37.760419 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232f6f7-9991-4387-9432-e5fe65e1ebdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee52b56bb444f6c8f4f5cd369e81689, user_id=cf7364b66a0549d48f77c1dd4c63d317, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:37.763205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232f6f7-9991-4387-9432-e5fe65e1ebdf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:37.846150 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1224/2422] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:37 2022] PUT /identity/v3/projects/5ee52b56bb444f6c8f4f5cd369e81689/users/cf7364b66a0549d48f77c1dd4c63d317/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:37.850111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232f6f7-9991-4387-9432-e5fe65e1ebdf admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:37.862427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9676d02e2709487e8b42bd33364c2109', 'request_id': 'req-b714ef38-13bf-4bc9-b581-39ffced45d8c'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:37.868765 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9676d02e2709487e8b42bd33364c2109', 'request_id': 'req-b714ef38-13bf-4bc9-b581-39ffced45d8c'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:37.920993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232f6f7-9991-4387-9432-e5fe65e1ebdf admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:37.925561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9676d02e2709487e8b42bd33364c2109', 'request_id': 'req-b714ef38-13bf-4bc9-b581-39ffced45d8c'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:37.939406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] The token cache is being invalidate because project 9676d02e2709487e8b42bd33364c2109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:37.939922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:37.940822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b714ef38-13bf-4bc9-b581-39ffced45d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:37.943090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1199/2423] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:37 2022] DELETE /identity/v3/projects/9676d02e2709487e8b42bd33364c2109 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:37.948867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275dbf7-e0e4-4979-a2fd-e7a1404e2e25 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:37.949389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275dbf7-e0e4-4979-a2fd-e7a1404e2e25 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:37.949887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275dbf7-e0e4-4979-a2fd-e7a1404e2e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:37.961276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:37.982454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c275dbf7-e0e4-4979-a2fd-e7a1404e2e25 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:37.985295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c275dbf7-e0e4-4979-a2fd-e7a1404e2e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:37.990327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19518295-f030-4800-9715-ef6d7b8f69b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:37.991064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19518295-f030-4800-9715-ef6d7b8f69b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:37.991423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19518295-f030-4800-9715-ef6d7b8f69b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:37.991604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19518295-f030-4800-9715-ef6d7b8f69b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:37.992306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19518295-f030-4800-9715-ef6d7b8f69b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:37.999572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19518295-f030-4800-9715-ef6d7b8f69b4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.007873 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1225/2424] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:38.013758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19518295-f030-4800-9715-ef6d7b8f69b4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:38.016169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-19518295-f030-4800-9715-ef6d7b8f69b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:38.031213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19518295-f030-4800-9715-ef6d7b8f69b4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:38.036320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6b70-498b-4ce2-b1a8-febedc6c7e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:38.037041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6b70-498b-4ce2-b1a8-febedc6c7e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.037315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6b70-498b-4ce2-b1a8-febedc6c7e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.037604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6b70-498b-4ce2-b1a8-febedc6c7e3b admin admin] PATH_INFO: `/v3/projects/5ee52b56bb444f6c8f4f5cd369e81689/users/cf7364b66a0549d48f77c1dd4c63d317/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.039721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6b70-498b-4ce2-b1a8-febedc6c7e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee52b56bb444f6c8f4f5cd369e81689, user_id=cf7364b66a0549d48f77c1dd4c63d317, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:38.042484 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6b70-498b-4ce2-b1a8-febedc6c7e3b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.060827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1200/2425] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:38.064011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8c8f-e168-49fe-891c-91e025cc5cf5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.065202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8c8f-e168-49fe-891c-91e025cc5cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.065710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8c8f-e168-49fe-891c-91e025cc5cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.083904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1226/2426] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:38 2022] PUT /identity/v3/projects/5ee52b56bb444f6c8f4f5cd369e81689/users/cf7364b66a0549d48f77c1dd4c63d317/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:38.097600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07af99e-8b0e-4615-adf6-848026e6cde3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.097890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07af99e-8b0e-4615-adf6-848026e6cde3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.098170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07af99e-8b0e-4615-adf6-848026e6cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.125143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7a5a8c8f-e168-49fe-891c-91e025cc5cf5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:38.126406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7a5a8c8f-e168-49fe-891c-91e025cc5cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:38.144819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a07af99e-8b0e-4615-adf6-848026e6cde3 None None] MFA Rules not processed for user `cf7364b66a0549d48f77c1dd4c63d317`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:38.146656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a07af99e-8b0e-4615-adf6-848026e6cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:38.196491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:38.210651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1201/2427] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:38.217988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a8c8f-e168-49fe-891c-91e025cc5cf5 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:38.231380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a8c8f-e168-49fe-891c-91e025cc5cf5 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:38.238764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8bf4-3afe-470e-8920-47cf6325b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:38.239360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8bf4-3afe-470e-8920-47cf6325b755 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.239710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8bf4-3afe-470e-8920-47cf6325b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.240208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8bf4-3afe-470e-8920-47cf6325b755 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.242000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c8bf4-3afe-470e-8920-47cf6325b755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:38.242312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c8bf4-3afe-470e-8920-47cf6325b755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:38.243936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c8bf4-3afe-470e-8920-47cf6325b755 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.245002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1227/2428] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:38.260414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1202/2429] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:15:38.261262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07af99e-8b0e-4615-adf6-848026e6cde3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:38.261381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8bf4-3afe-470e-8920-47cf6325b755 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:38.263308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a07af99e-8b0e-4615-adf6-848026e6cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:38.271025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8bf4-3afe-470e-8920-47cf6325b755 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:38.276381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e19ca-3eb6-4865-9c01-34923dba629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:38.277016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e19ca-3eb6-4865-9c01-34923dba629e admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.277300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e19ca-3eb6-4865-9c01-34923dba629e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.277577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e19ca-3eb6-4865-9c01-34923dba629e admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.278244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e19ca-3eb6-4865-9c01-34923dba629e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:38.281700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e19ca-3eb6-4865-9c01-34923dba629e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.319069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07af99e-8b0e-4615-adf6-848026e6cde3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:38.323289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e771a-30f3-42ca-8716-0362d328ec87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:38.323901 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e771a-30f3-42ca-8716-0362d328ec87 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.324182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e771a-30f3-42ca-8716-0362d328ec87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.324454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e771a-30f3-42ca-8716-0362d328ec87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.333446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e771a-30f3-42ca-8716-0362d328ec87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:38.334889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e771a-30f3-42ca-8716-0362d328ec87 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.344743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1228/2430] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:15:38.447988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1203/2431] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:38 2022] POST /identity/v3/projects => generated 363 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:38.452326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e771a-30f3-42ca-8716-0362d328ec87 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:38.462580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e771a-30f3-42ca-8716-0362d328ec87 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:38.519618 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a0405-4e78-46ac-b9a7-e43ea9d4bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:38.520300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a0405-4e78-46ac-b9a7-e43ea9d4bdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.520509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a0405-4e78-46ac-b9a7-e43ea9d4bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.520804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a0405-4e78-46ac-b9a7-e43ea9d4bdb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.521479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a0405-4e78-46ac-b9a7-e43ea9d4bdb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:38.523383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a0405-4e78-46ac-b9a7-e43ea9d4bdb5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.663505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1229/2432] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:38 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:38.668090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e19ca-3eb6-4865-9c01-34923dba629e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:38.679344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e19ca-3eb6-4865-9c01-34923dba629e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:38.679964 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a0405-4e78-46ac-b9a7-e43ea9d4bdb5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:38.683961 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4138c5-2e57-4130-aad6-35bcf7dd52d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:38.684567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4138c5-2e57-4130-aad6-35bcf7dd52d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.684874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4138c5-2e57-4130-aad6-35bcf7dd52d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.685151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4138c5-2e57-4130-aad6-35bcf7dd52d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.685965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4138c5-2e57-4130-aad6-35bcf7dd52d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:38.687558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4138c5-2e57-4130-aad6-35bcf7dd52d3 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.698455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1204/2433] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:38.702999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4138c5-2e57-4130-aad6-35bcf7dd52d3 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:38.715047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4138c5-2e57-4130-aad6-35bcf7dd52d3 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:38.720381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e85a1-de6c-4f48-abe3-bba824f8ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:38.721017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e85a1-de6c-4f48-abe3-bba824f8ead1 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.721296 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e85a1-de6c-4f48-abe3-bba824f8ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.721568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e85a1-de6c-4f48-abe3-bba824f8ead1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.722393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e85a1-de6c-4f48-abe3-bba824f8ead1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:38.724010 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e85a1-de6c-4f48-abe3-bba824f8ead1 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.734553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1205/2434] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:38.738585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e85a1-de6c-4f48-abe3-bba824f8ead1 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:38.743564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a0405-4e78-46ac-b9a7-e43ea9d4bdb5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:38.747260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f46422-0a5b-4056-a552-87760eea0bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:38.747816 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f46422-0a5b-4056-a552-87760eea0bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.750717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f46422-0a5b-4056-a552-87760eea0bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.750717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f46422-0a5b-4056-a552-87760eea0bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.750943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e85a1-de6c-4f48-abe3-bba824f8ead1 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:38.751041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-02f46422-0a5b-4056-a552-87760eea0bb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:38.753210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb0234-08d9-4fd4-a6ad-be3a3840abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:38.753837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb0234-08d9-4fd4-a6ad-be3a3840abde admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.754116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb0234-08d9-4fd4-a6ad-be3a3840abde admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.754386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb0234-08d9-4fd4-a6ad-be3a3840abde admin admin] PATH_INFO: `/v3/projects/92dd5a39ed594ba195b484aeb6d6d207/users/a899cf29be6542658e3bc389d9a7f36f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.769065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb0234-08d9-4fd4-a6ad-be3a3840abde admin admin] RBAC: Authorizing `identity:create_grant(project_id=92dd5a39ed594ba195b484aeb6d6d207, user_id=a899cf29be6542658e3bc389d9a7f36f, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:38.771755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb0234-08d9-4fd4-a6ad-be3a3840abde admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.808294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f46422-0a5b-4056-a552-87760eea0bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:38.809750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f46422-0a5b-4056-a552-87760eea0bb1 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:38.817042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:38.821332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1230/2435] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:15:38.897174 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1206/2436] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:38 2022] PUT /identity/v3/projects/92dd5a39ed594ba195b484aeb6d6d207/users/a899cf29be6542658e3bc389d9a7f36f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:38.908670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdc016-9c3d-4322-9cc2-3788d1e1557f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:38.908980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdc016-9c3d-4322-9cc2-3788d1e1557f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:38.909258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdc016-9c3d-4322-9cc2-3788d1e1557f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:38.937816 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8ecdc016-9c3d-4322-9cc2-3788d1e1557f None None] MFA Rules not processed for user `a899cf29be6542658e3bc389d9a7f36f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:38.938974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8ecdc016-9c3d-4322-9cc2-3788d1e1557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:39.003556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1231/2437] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:39.008046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb0234-08d9-4fd4-a6ad-be3a3840abde admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:39.070086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb0234-08d9-4fd4-a6ad-be3a3840abde admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:39.075060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0d626-2245-46bf-abd0-adcb1f5e4248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:39.075664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0d626-2245-46bf-abd0-adcb1f5e4248 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:39.075939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0d626-2245-46bf-abd0-adcb1f5e4248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:39.076210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0d626-2245-46bf-abd0-adcb1f5e4248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:39.076890 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0d626-2245-46bf-abd0-adcb1f5e4248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:39.078807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0d626-2245-46bf-abd0-adcb1f5e4248 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:39.200387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1207/2438] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:39 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:39.204363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdc016-9c3d-4322-9cc2-3788d1e1557f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:39.216424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdc016-9c3d-4322-9cc2-3788d1e1557f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:39.274783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbafd8-2fab-477a-b01f-6e9e48af76c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:39.275443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbafd8-2fab-477a-b01f-6e9e48af76c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:39.275710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbafd8-2fab-477a-b01f-6e9e48af76c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:39.275987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbafd8-2fab-477a-b01f-6e9e48af76c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:39.276650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbafd8-2fab-477a-b01f-6e9e48af76c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:39.278603 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbafd8-2fab-477a-b01f-6e9e48af76c9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:39.331237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:39.411532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1232/2439] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:39 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:39.415719 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0d626-2245-46bf-abd0-adcb1f5e4248 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:39.427762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0d626-2245-46bf-abd0-adcb1f5e4248 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:39.433884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d5ea-62b3-415d-9be2-7ba5c40798ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:39.434955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d5ea-62b3-415d-9be2-7ba5c40798ed admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:39.435419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d5ea-62b3-415d-9be2-7ba5c40798ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:39.435699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d5ea-62b3-415d-9be2-7ba5c40798ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:39.436404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4d5ea-62b3-415d-9be2-7ba5c40798ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:39.438047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4d5ea-62b3-415d-9be2-7ba5c40798ed admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:39.452743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1208/2440] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:39.454555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbafd8-2fab-477a-b01f-6e9e48af76c9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:39.465395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbafd8-2fab-477a-b01f-6e9e48af76c9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:39.470479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ace8b-7ad5-45a2-93a5-2c8c7be48e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:39.475860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ace8b-7ad5-45a2-93a5-2c8c7be48e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:39.475860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ace8b-7ad5-45a2-93a5-2c8c7be48e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:39.475860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ace8b-7ad5-45a2-93a5-2c8c7be48e79 admin admin] PATH_INFO: `/v3/projects/a50dfc59aa984fcbb616ed547167625a/users/d55d5a5f24104047aecf20aea2f00d5f/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:39.487104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ace8b-7ad5-45a2-93a5-2c8c7be48e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50dfc59aa984fcbb616ed547167625a, user_id=d55d5a5f24104047aecf20aea2f00d5f, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:39.489866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ace8b-7ad5-45a2-93a5-2c8c7be48e79 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:39.553726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d5ea-62b3-415d-9be2-7ba5c40798ed admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:39.555542 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5be4d5ea-62b3-415d-9be2-7ba5c40798ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:39.615114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:39.617102 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1233/2441] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:39 2022] PUT /identity/v3/projects/a50dfc59aa984fcbb616ed547167625a/users/d55d5a5f24104047aecf20aea2f00d5f/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:39.619239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d5ea-62b3-415d-9be2-7ba5c40798ed admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:39.621097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ace8b-7ad5-45a2-93a5-2c8c7be48e79 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:39.672548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7efc5-53a0-4ba6-b247-c5e5090fb126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:39.673207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7efc5-53a0-4ba6-b247-c5e5090fb126 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:39.673545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7efc5-53a0-4ba6-b247-c5e5090fb126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:39.673828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7efc5-53a0-4ba6-b247-c5e5090fb126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:39.675715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-99b7efc5-53a0-4ba6-b247-c5e5090fb126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:39.692885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ace8b-7ad5-45a2-93a5-2c8c7be48e79 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:39.698206 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994bf5-2c7f-41bc-a8e6-b1391936723d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:39.698753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994bf5-2c7f-41bc-a8e6-b1391936723d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:39.699036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994bf5-2c7f-41bc-a8e6-b1391936723d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:39.699310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994bf5-2c7f-41bc-a8e6-b1391936723d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:39.700012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27994bf5-2c7f-41bc-a8e6-b1391936723d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:39.701647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27994bf5-2c7f-41bc-a8e6-b1391936723d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:39.712648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1234/2442] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:39.716217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994bf5-2c7f-41bc-a8e6-b1391936723d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:39.727679 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994bf5-2c7f-41bc-a8e6-b1391936723d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:39.734198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07f5b7-0e3a-4475-b5ff-dd8237171227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:39.734198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f5b7-0e3a-4475-b5ff-dd8237171227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:39.734412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f5b7-0e3a-4475-b5ff-dd8237171227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:39.734578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f5b7-0e3a-4475-b5ff-dd8237171227 admin admin] PATH_INFO: `/v3/projects/a50dfc59aa984fcbb616ed547167625a/users/d55d5a5f24104047aecf20aea2f00d5f/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:39.736590 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07f5b7-0e3a-4475-b5ff-dd8237171227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50dfc59aa984fcbb616ed547167625a, user_id=d55d5a5f24104047aecf20aea2f00d5f, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:39.739332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07f5b7-0e3a-4475-b5ff-dd8237171227 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:39.742894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7efc5-53a0-4ba6-b247-c5e5090fb126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:39.744711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7efc5-53a0-4ba6-b247-c5e5090fb126 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:39.750387 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1235/2443] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:39 2022] PUT /identity/v3/projects/a50dfc59aa984fcbb616ed547167625a/users/d55d5a5f24104047aecf20aea2f00d5f/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:39.762325 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1ee9e-e8b7-4fe7-9dc0-641c15934523 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:39.762773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1ee9e-e8b7-4fe7-9dc0-641c15934523 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:39.762921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1ee9e-e8b7-4fe7-9dc0-641c15934523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:39.763578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1209/2444] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:15:39.802423 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6aa1ee9e-e8b7-4fe7-9dc0-641c15934523 None None] MFA Rules not processed for user `d55d5a5f24104047aecf20aea2f00d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:39.804147 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6aa1ee9e-e8b7-4fe7-9dc0-641c15934523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:39.857572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:39.876949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1236/2445] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:39.889379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7efc5-53a0-4ba6-b247-c5e5090fb126 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:39.947124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7efc5-53a0-4ba6-b247-c5e5090fb126 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:39.999534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9024c50-b4d5-4507-9156-84512030969a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:40.000199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9024c50-b4d5-4507-9156-84512030969a service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:40.000483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9024c50-b4d5-4507-9156-84512030969a service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:40.000753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9024c50-b4d5-4507-9156-84512030969a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:40.011449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9024c50-b4d5-4507-9156-84512030969a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:40.013481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9024c50-b4d5-4507-9156-84512030969a service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:40.024476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1210/2446] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:39 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:40.356847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1ee9e-e8b7-4fe7-9dc0-641c15934523 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:40.367010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1ee9e-e8b7-4fe7-9dc0-641c15934523 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:40.370752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0eaa0-6612-4df9-a45c-065c9a518372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:40.371377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0eaa0-6612-4df9-a45c-065c9a518372 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:40.371658 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0eaa0-6612-4df9-a45c-065c9a518372 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:40.371932 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0eaa0-6612-4df9-a45c-065c9a518372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:40.437627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0eaa0-6612-4df9-a45c-065c9a518372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:40.439072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0eaa0-6612-4df9-a45c-065c9a518372 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:40.448826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1237/2447] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:44.791495 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9024c50-b4d5-4507-9156-84512030969a service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:44.808859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:44.883605 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9024c50-b4d5-4507-9156-84512030969a service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:44.889512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:44.890774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:44.891119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:44.891459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] PATH_INFO: `/v3/users/a899cf29be6542658e3bc389d9a7f36f` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:44.892989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a899cf29be6542658e3bc389d9a7f36f)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:44.895370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:44.939825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0eaa0-6612-4df9-a45c-065c9a518372 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:44.942881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-40c0eaa0-6612-4df9-a45c-065c9a518372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:44.962441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0eaa0-6612-4df9-a45c-065c9a518372 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:44.969907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:44.969907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:44.969907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:44.969907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] PATH_INFO: `/v3/users/9b585090272c4b4ab7d1937ebc9fa649` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:44.970261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b585090272c4b4ab7d1937ebc9fa649)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:44.971826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:45.137142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a899cf29be6542658e3bc389d9a7f36f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.137826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a899cf29be6542658e3bc389d9a7f36f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.251056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a899cf29be6542658e3bc389d9a7f36f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.251727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a899cf29be6542658e3bc389d9a7f36f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.266260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-54a99d22-aec1-4be8-90b8-8eda88cb4f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a899cf29be6542658e3bc389d9a7f36f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.267663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b585090272c4b4ab7d1937ebc9fa649'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.268597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b585090272c4b4ab7d1937ebc9fa649'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.277168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b585090272c4b4ab7d1937ebc9fa649'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.277878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b585090272c4b4ab7d1937ebc9fa649'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.282920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1211/2448] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:44 2022] DELETE /identity/v3/users/a899cf29be6542658e3bc389d9a7f36f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:45.287325 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb345a4-06cc-4253-b508-afb85a1c82e4 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:45.287672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb345a4-06cc-4253-b508-afb85a1c82e4 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:45.288590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb345a4-06cc-4253-b508-afb85a1c82e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:45.292542 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b585090272c4b4ab7d1937ebc9fa649'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:45.308113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-5eb345a4-06cc-4253-b508-afb85a1c82e4 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:45.309351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5eb345a4-06cc-4253-b508-afb85a1c82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:45.377381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1212/2449] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:45.387921 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb345a4-06cc-4253-b508-afb85a1c82e4 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:45.389447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5eb345a4-06cc-4253-b508-afb85a1c82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:45.422116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1238/2450] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:44 2022] DELETE /identity/v3/users/9b585090272c4b4ab7d1937ebc9fa649 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:45.434119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:45.457728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb345a4-06cc-4253-b508-afb85a1c82e4 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:45.511493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fe652-fb60-4d0f-8625-c4aae5127eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:45.512155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fe652-fb60-4d0f-8625-c4aae5127eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:45.512420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fe652-fb60-4d0f-8625-c4aae5127eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:45.513339 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fe652-fb60-4d0f-8625-c4aae5127eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:45.578277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fe652-fb60-4d0f-8625-c4aae5127eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:45.580114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fe652-fb60-4d0f-8625-c4aae5127eb4 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:45.591493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1213/2451] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:15:45.853335 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:45.855993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:45.873519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a98b76-d79d-443c-8f50-5ca5f07612ba admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:45.879065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:45.879293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:45.879774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:45.880145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] PATH_INFO: `/v3/projects/5ce6da9de67248e691831a5a2bb6679a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:45.887682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ce6da9de67248e691831a5a2bb6679a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:45.908188 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:46.050820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce6da9de67248e691831a5a2bb6679a', 'request_id': 'req-23fa2f06-4fad-4128-95fe-8a248c365126'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.055214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:46.188391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce6da9de67248e691831a5a2bb6679a', 'request_id': 'req-23fa2f06-4fad-4128-95fe-8a248c365126'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.195447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce6da9de67248e691831a5a2bb6679a', 'request_id': 'req-23fa2f06-4fad-4128-95fe-8a248c365126'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.195585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fe652-fb60-4d0f-8625-c4aae5127eb4 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:46.197056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-3d6fe652-fb60-4d0f-8625-c4aae5127eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:46.212753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] The token cache is being invalidate because project 5ce6da9de67248e691831a5a2bb6679a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:46.212936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.213563 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-23fa2f06-4fad-4128-95fe-8a248c365126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.215189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1239/2452] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:45 2022] DELETE /identity/v3/projects/5ce6da9de67248e691831a5a2bb6679a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:46.220367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece52eb-6418-4ecb-aac5-1cd544b50232 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.220677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fe652-fb60-4d0f-8625-c4aae5127eb4 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:46.220820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece52eb-6418-4ecb-aac5-1cd544b50232 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.221254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece52eb-6418-4ecb-aac5-1cd544b50232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.242836 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cece52eb-6418-4ecb-aac5-1cd544b50232 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:46.244102 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cece52eb-6418-4ecb-aac5-1cd544b50232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:46.280818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:46.281457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.281762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.282039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] PATH_INFO: `/v3/projects/92dd5a39ed594ba195b484aeb6d6d207` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.283247 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=92dd5a39ed594ba195b484aeb6d6d207)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:46.285211 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:46.303203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1240/2453] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:46.311977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f4bc-823d-4970-b66b-df120e5b46ea None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.312242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f4bc-823d-4970-b66b-df120e5b46ea None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.312573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f4bc-823d-4970-b66b-df120e5b46ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.331591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4d56f4bc-823d-4970-b66b-df120e5b46ea None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:46.332772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4d56f4bc-823d-4970-b66b-df120e5b46ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:46.340695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1241/2454] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:46.344970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56f4bc-823d-4970-b66b-df120e5b46ea None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:46.354252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56f4bc-823d-4970-b66b-df120e5b46ea None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:46.360118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35073ec6-09cf-4bbe-9ed4-184fbfb2049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:46.360731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35073ec6-09cf-4bbe-9ed4-184fbfb2049c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.361047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35073ec6-09cf-4bbe-9ed4-184fbfb2049c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.361320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35073ec6-09cf-4bbe-9ed4-184fbfb2049c admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.362047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35073ec6-09cf-4bbe-9ed4-184fbfb2049c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:46.362351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35073ec6-09cf-4bbe-9ed4-184fbfb2049c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:46.364033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35073ec6-09cf-4bbe-9ed4-184fbfb2049c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:46.376663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1242/2455] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:15:46.381175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35073ec6-09cf-4bbe-9ed4-184fbfb2049c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:46.388802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92dd5a39ed594ba195b484aeb6d6d207', 'request_id': 'req-c644fe9c-d671-4132-8b16-8e95a971f43e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.391285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35073ec6-09cf-4bbe-9ed4-184fbfb2049c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:46.394496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92dd5a39ed594ba195b484aeb6d6d207', 'request_id': 'req-c644fe9c-d671-4132-8b16-8e95a971f43e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.445173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92dd5a39ed594ba195b484aeb6d6d207', 'request_id': 'req-c644fe9c-d671-4132-8b16-8e95a971f43e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.446365 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75728342-3709-4160-9d66-87eb6f0e7e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:46.447151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75728342-3709-4160-9d66-87eb6f0e7e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.447435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75728342-3709-4160-9d66-87eb6f0e7e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.447712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75728342-3709-4160-9d66-87eb6f0e7e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.448687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75728342-3709-4160-9d66-87eb6f0e7e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:46.450677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75728342-3709-4160-9d66-87eb6f0e7e47 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:46.457376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] The token cache is being invalidate because project 92dd5a39ed594ba195b484aeb6d6d207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:46.457671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.458440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.459959 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1214/2456] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:46 2022] DELETE /identity/v3/projects/92dd5a39ed594ba195b484aeb6d6d207 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:46.463825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:46.465243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:46.478417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644fe9c-d671-4132-8b16-8e95a971f43e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:46.483096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:46.483720 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.484002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.484279 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] PATH_INFO: `/v3/users/d55d5a5f24104047aecf20aea2f00d5f` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.485464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55d5a5f24104047aecf20aea2f00d5f)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:46.487454 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:46.546718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1243/2457] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:46 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:46.551241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75728342-3709-4160-9d66-87eb6f0e7e47 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:46.552809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-75728342-3709-4160-9d66-87eb6f0e7e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:46.614748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75728342-3709-4160-9d66-87eb6f0e7e47 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:46.619475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb62e7-4c14-4b13-9246-f4a6782c3230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:46.620087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb62e7-4c14-4b13-9246-f4a6782c3230 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.620374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb62e7-4c14-4b13-9246-f4a6782c3230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.620649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb62e7-4c14-4b13-9246-f4a6782c3230 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.621340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb62e7-4c14-4b13-9246-f4a6782c3230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:46.623255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb62e7-4c14-4b13-9246-f4a6782c3230 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:46.665139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55d5a5f24104047aecf20aea2f00d5f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.665854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55d5a5f24104047aecf20aea2f00d5f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.737134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1244/2458] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:46 2022] POST /identity/v3/users => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:46.741144 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb62e7-4c14-4b13-9246-f4a6782c3230 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:46.750733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb62e7-4c14-4b13-9246-f4a6782c3230 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:46.756051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b8dd-37fa-40c6-a7c1-b75cd686f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:46.756629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b8dd-37fa-40c6-a7c1-b75cd686f4be admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.756940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b8dd-37fa-40c6-a7c1-b75cd686f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.757213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b8dd-37fa-40c6-a7c1-b75cd686f4be admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.758268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57b8dd-37fa-40c6-a7c1-b75cd686f4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:46.759547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57b8dd-37fa-40c6-a7c1-b75cd686f4be admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:46.759668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55d5a5f24104047aecf20aea2f00d5f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.760411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55d5a5f24104047aecf20aea2f00d5f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.762899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:46.773308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1245/2459] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:46.774389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b8dd-37fa-40c6-a7c1-b75cd686f4be admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:46.776411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fa57b8dd-37fa-40c6-a7c1-b75cd686f4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:46.776546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55d5a5f24104047aecf20aea2f00d5f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:46.789719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b8dd-37fa-40c6-a7c1-b75cd686f4be admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:46.789878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1215/2460] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:46 2022] DELETE /identity/v3/users/d55d5a5f24104047aecf20aea2f00d5f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:46.848579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b7eee-b9e4-4374-9f6e-a18f2cb3af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:46.849366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7eee-b9e4-4374-9f6e-a18f2cb3af85 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.849655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7eee-b9e4-4374-9f6e-a18f2cb3af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.854434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7eee-b9e4-4374-9f6e-a18f2cb3af85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.854434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b7eee-b9e4-4374-9f6e-a18f2cb3af85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:46.854434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b7eee-b9e4-4374-9f6e-a18f2cb3af85 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:46.862879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1246/2461] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:46.867072 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:46.877441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e32df9-9a99-4cb7-a8e9-3d8a808df73b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:46.882731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e0627-2fa2-4118-9d5c-15a7a1bdd4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:46.883445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0627-2fa2-4118-9d5c-15a7a1bdd4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:46.883717 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0627-2fa2-4118-9d5c-15a7a1bdd4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:46.883991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0627-2fa2-4118-9d5c-15a7a1bdd4cc admin admin] PATH_INFO: `/v3/projects/4d30568e84a34c319de7c6ba1699826b/users/d7d0ac59f19c4bafaa9d5a3bfb87a711/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:46.901032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e0627-2fa2-4118-9d5c-15a7a1bdd4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d30568e84a34c319de7c6ba1699826b, user_id=d7d0ac59f19c4bafaa9d5a3bfb87a711, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:46.903648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e0627-2fa2-4118-9d5c-15a7a1bdd4cc admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:46.997709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1216/2462] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:46 2022] PUT /identity/v3/projects/4d30568e84a34c319de7c6ba1699826b/users/d7d0ac59f19c4bafaa9d5a3bfb87a711/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:47.008233 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58f02e-0a67-4918-a2fd-76fd6e7ec87a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.008806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58f02e-0a67-4918-a2fd-76fd6e7ec87a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.009239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58f02e-0a67-4918-a2fd-76fd6e7ec87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.042957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4f58f02e-0a67-4918-a2fd-76fd6e7ec87a None None] MFA Rules not processed for user `d7d0ac59f19c4bafaa9d5a3bfb87a711`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:47.044326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4f58f02e-0a67-4918-a2fd-76fd6e7ec87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:47.120558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1247/2463] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:47.125067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e0627-2fa2-4118-9d5c-15a7a1bdd4cc admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.160620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:47.191270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e0627-2fa2-4118-9d5c-15a7a1bdd4cc admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.196139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22213b-1724-4a6f-9d90-7789ddb016de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.196846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22213b-1724-4a6f-9d90-7789ddb016de admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.197217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22213b-1724-4a6f-9d90-7789ddb016de admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.197487 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22213b-1724-4a6f-9d90-7789ddb016de admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.198153 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22213b-1724-4a6f-9d90-7789ddb016de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.200011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22213b-1724-4a6f-9d90-7789ddb016de admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.246489 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58f02e-0a67-4918-a2fd-76fd6e7ec87a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.248487 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4f58f02e-0a67-4918-a2fd-76fd6e7ec87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:47.273011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58f02e-0a67-4918-a2fd-76fd6e7ec87a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.278547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.279199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.280863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.280863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] PATH_INFO: `/v3/projects/a50dfc59aa984fcbb616ed547167625a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.281059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50dfc59aa984fcbb616ed547167625a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.282937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.307943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1217/2464] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:47 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:47.309264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22213b-1724-4a6f-9d90-7789ddb016de admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.314033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:47.375221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22213b-1724-4a6f-9d90-7789ddb016de admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.380044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89a924-4201-4247-b505-ee5cf0091335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.380662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89a924-4201-4247-b505-ee5cf0091335 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.380976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89a924-4201-4247-b505-ee5cf0091335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.381249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89a924-4201-4247-b505-ee5cf0091335 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.382466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89a924-4201-4247-b505-ee5cf0091335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.384378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89a924-4201-4247-b505-ee5cf0091335 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.417835 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50dfc59aa984fcbb616ed547167625a', 'request_id': 'req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:47.485553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1218/2465] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:47 2022] POST /identity/v3/users => generated 309 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:47.489501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89a924-4201-4247-b505-ee5cf0091335 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.499356 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89a924-4201-4247-b505-ee5cf0091335 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.502546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50dfc59aa984fcbb616ed547167625a', 'request_id': 'req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:47.509759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50dfc59aa984fcbb616ed547167625a', 'request_id': 'req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:47.521644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] The token cache is being invalidate because project a50dfc59aa984fcbb616ed547167625a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:47.522902 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:47.523737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ebb7628e-1140-4af1-9ac0-0c7c8f88f975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:47.525575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1248/2466] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:47 2022] DELETE /identity/v3/projects/a50dfc59aa984fcbb616ed547167625a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:47.530597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f091d1-360c-42ce-837f-20b51246b89a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.530881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f091d1-360c-42ce-837f-20b51246b89a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.531156 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f091d1-360c-42ce-837f-20b51246b89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.550582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-78f091d1-360c-42ce-837f-20b51246b89a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:47.551897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-78f091d1-360c-42ce-837f-20b51246b89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:47.559229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7ac1d-3036-4844-965c-33d23cccf23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.559844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ac1d-3036-4844-965c-33d23cccf23f admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.560123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ac1d-3036-4844-965c-33d23cccf23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.560396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ac1d-3036-4844-965c-33d23cccf23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.561985 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7ac1d-3036-4844-965c-33d23cccf23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.562735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7ac1d-3036-4844-965c-33d23cccf23f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.575131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1219/2467] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:47.581294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7ac1d-3036-4844-965c-33d23cccf23f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.581294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-13e7ac1d-3036-4844-965c-33d23cccf23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:47.594105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7ac1d-3036-4844-965c-33d23cccf23f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.600076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f7a88-0a2e-434f-8972-a7b29127f71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.601492 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f7a88-0a2e-434f-8972-a7b29127f71d admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.601780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f7a88-0a2e-434f-8972-a7b29127f71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.602066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f7a88-0a2e-434f-8972-a7b29127f71d admin admin] PATH_INFO: `/v3/projects/e8f63935278d4717a92cb50d280dcb64/users/ecd2230d82434f3a86f36c3db16d8cbc/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.618775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f7a88-0a2e-434f-8972-a7b29127f71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f63935278d4717a92cb50d280dcb64, user_id=ecd2230d82434f3a86f36c3db16d8cbc, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.620696 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1249/2468] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:47.629758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f7a88-0a2e-434f-8972-a7b29127f71d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.635252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d51b02-f550-45c3-82d2-17ee4dd53ad9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.635252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d51b02-f550-45c3-82d2-17ee4dd53ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.635252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d51b02-f550-45c3-82d2-17ee4dd53ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.651923 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-04d51b02-f550-45c3-82d2-17ee4dd53ad9 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:47.653174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-04d51b02-f550-45c3-82d2-17ee4dd53ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:47.661317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1250/2469] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:47.665801 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d51b02-f550-45c3-82d2-17ee4dd53ad9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.674626 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d51b02-f550-45c3-82d2-17ee4dd53ad9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.679937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c7f08-8155-4bec-986a-fd076996a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.680523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7f08-8155-4bec-986a-fd076996a73a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.680883 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7f08-8155-4bec-986a-fd076996a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.681155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7f08-8155-4bec-986a-fd076996a73a admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.681832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c7f08-8155-4bec-986a-fd076996a73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:47.682135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c7f08-8155-4bec-986a-fd076996a73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.683786 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c7f08-8155-4bec-986a-fd076996a73a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.695067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1251/2470] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:15:47.699163 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c7f08-8155-4bec-986a-fd076996a73a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.708524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c7f08-8155-4bec-986a-fd076996a73a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.713916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1220/2471] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:47 2022] PUT /identity/v3/projects/e8f63935278d4717a92cb50d280dcb64/users/ecd2230d82434f3a86f36c3db16d8cbc/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:47.718399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f7a88-0a2e-434f-8972-a7b29127f71d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.768152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c114-aefb-4598-b8b9-31a6f3985d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.768703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c114-aefb-4598-b8b9-31a6f3985d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.772904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c114-aefb-4598-b8b9-31a6f3985d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.772904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c114-aefb-4598-b8b9-31a6f3985d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.772904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c114-aefb-4598-b8b9-31a6f3985d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.772904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c114-aefb-4598-b8b9-31a6f3985d3e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.784484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f7a88-0a2e-434f-8972-a7b29127f71d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.789885 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:47.790201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb165-432e-4091-925c-579532cec2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.790804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb165-432e-4091-925c-579532cec2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.791104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb165-432e-4091-925c-579532cec2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.791376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb165-432e-4091-925c-579532cec2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.792061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb165-432e-4091-925c-579532cec2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.793696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb165-432e-4091-925c-579532cec2a2 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.804162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1221/2472] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:47.808293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb165-432e-4091-925c-579532cec2a2 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.817565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb165-432e-4091-925c-579532cec2a2 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.823738 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e1f05-47a8-4862-a38a-565e13328c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.824632 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e1f05-47a8-4862-a38a-565e13328c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.824813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e1f05-47a8-4862-a38a-565e13328c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.825160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e1f05-47a8-4862-a38a-565e13328c05 admin admin] PATH_INFO: `/v3/projects/e8f63935278d4717a92cb50d280dcb64/users/ecd2230d82434f3a86f36c3db16d8cbc/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.827360 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e1f05-47a8-4862-a38a-565e13328c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f63935278d4717a92cb50d280dcb64, user_id=ecd2230d82434f3a86f36c3db16d8cbc, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.830393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e1f05-47a8-4862-a38a-565e13328c05 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.840939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1222/2473] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:47 2022] PUT /identity/v3/projects/e8f63935278d4717a92cb50d280dcb64/users/ecd2230d82434f3a86f36c3db16d8cbc/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:47.844949 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:47.853418 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b853d-70f1-4c64-9bc2-6bc4343398e1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.853730 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b853d-70f1-4c64-9bc2-6bc4343398e1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.854008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b853d-70f1-4c64-9bc2-6bc4343398e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.865166 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1252/2474] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:47 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:47.870759 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c114-aefb-4598-b8b9-31a6f3985d3e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.885934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-616b853d-70f1-4c64-9bc2-6bc4343398e1 None None] MFA Rules not processed for user `ecd2230d82434f3a86f36c3db16d8cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:47.887145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-616b853d-70f1-4c64-9bc2-6bc4343398e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:47.932892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c114-aefb-4598-b8b9-31a6f3985d3e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:47.937676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc31f3-9fb9-4d3a-be15-b5ea56afa3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:47.938289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc31f3-9fb9-4d3a-be15-b5ea56afa3ab admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:47.938569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc31f3-9fb9-4d3a-be15-b5ea56afa3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:47.938847 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc31f3-9fb9-4d3a-be15-b5ea56afa3ab admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:47.939503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc31f3-9fb9-4d3a-be15-b5ea56afa3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:47.941458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc31f3-9fb9-4d3a-be15-b5ea56afa3ab admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:47.954897 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1223/2475] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:47.965715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b853d-70f1-4c64-9bc2-6bc4343398e1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:47.967112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-616b853d-70f1-4c64-9bc2-6bc4343398e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:48.023841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b853d-70f1-4c64-9bc2-6bc4343398e1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:48.027766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ee4cd-0c0e-42a3-9f1b-17e959128da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:48.036434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee4cd-0c0e-42a3-9f1b-17e959128da0 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:48.036434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee4cd-0c0e-42a3-9f1b-17e959128da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:48.036434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee4cd-0c0e-42a3-9f1b-17e959128da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:48.038831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ee4cd-0c0e-42a3-9f1b-17e959128da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:48.040276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ee4cd-0c0e-42a3-9f1b-17e959128da0 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:48.049606 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1224/2476] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:47 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:15:48.080143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1253/2477] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:47 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:48.084121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ee4cd-0c0e-42a3-9f1b-17e959128da0 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:48.097094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ee4cd-0c0e-42a3-9f1b-17e959128da0 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:48.103116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7651347-b61c-4119-9ae8-0c4358e30802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:48.103771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7651347-b61c-4119-9ae8-0c4358e30802 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:48.104028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7651347-b61c-4119-9ae8-0c4358e30802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:48.104301 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7651347-b61c-4119-9ae8-0c4358e30802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:48.105204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7651347-b61c-4119-9ae8-0c4358e30802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:48.107126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7651347-b61c-4119-9ae8-0c4358e30802 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:48.123132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1225/2478] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:48.124363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc31f3-9fb9-4d3a-be15-b5ea56afa3ab admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:48.139403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc31f3-9fb9-4d3a-be15-b5ea56afa3ab admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:48.143620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac1cb9-8ce5-46fb-b581-5f27c6921530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:48.144241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac1cb9-8ce5-46fb-b581-5f27c6921530 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:48.144522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac1cb9-8ce5-46fb-b581-5f27c6921530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:48.144809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac1cb9-8ce5-46fb-b581-5f27c6921530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:48.146296 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac1cb9-8ce5-46fb-b581-5f27c6921530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:48.149041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac1cb9-8ce5-46fb-b581-5f27c6921530 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:48.174235 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1254/2479] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:48.175896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7651347-b61c-4119-9ae8-0c4358e30802 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:48.200285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7651347-b61c-4119-9ae8-0c4358e30802 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:48.219307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac1cb9-8ce5-46fb-b581-5f27c6921530 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:48.224253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea621a42-0867-48b5-a472-2f27495258ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:48.225138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea621a42-0867-48b5-a472-2f27495258ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:48.226119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea621a42-0867-48b5-a472-2f27495258ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:48.226496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea621a42-0867-48b5-a472-2f27495258ef admin admin] PATH_INFO: `/v3/projects/69559b4ae4254130b8c1adbfcb5ecc5f/users/624847b30f2e45679762c694e02d1e5d/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:48.231800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac1cb9-8ce5-46fb-b581-5f27c6921530 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:48.237004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:48.237730 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:48.238164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:48.238785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] PATH_INFO: `/v3/users/d7d0ac59f19c4bafaa9d5a3bfb87a711` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:48.240294 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d0ac59f19c4bafaa9d5a3bfb87a711)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:48.242545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:48.247268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea621a42-0867-48b5-a472-2f27495258ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=69559b4ae4254130b8c1adbfcb5ecc5f, user_id=624847b30f2e45679762c694e02d1e5d, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:48.250657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea621a42-0867-48b5-a472-2f27495258ef admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:48.264511 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:48.320978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1226/2480] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:48 2022] PUT /identity/v3/projects/69559b4ae4254130b8c1adbfcb5ecc5f/users/624847b30f2e45679762c694e02d1e5d/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:48.326694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d47b-6861-4690-975b-fd4b9f30aab2 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:48.327043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d47b-6861-4690-975b-fd4b9f30aab2 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:48.327381 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98d47b-6861-4690-975b-fd4b9f30aab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:48.347648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-6c98d47b-6861-4690-975b-fd4b9f30aab2 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:48.349021 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6c98d47b-6861-4690-975b-fd4b9f30aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:48.385892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:48.412398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1227/2481] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:48.418586 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d0ac59f19c4bafaa9d5a3bfb87a711'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:48.419256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d0ac59f19c4bafaa9d5a3bfb87a711'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:48.422150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98d47b-6861-4690-975b-fd4b9f30aab2 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:48.424137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6c98d47b-6861-4690-975b-fd4b9f30aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:48.426900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d0ac59f19c4bafaa9d5a3bfb87a711'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:48.429023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d0ac59f19c4bafaa9d5a3bfb87a711'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:48.439455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d0ac59f19c4bafaa9d5a3bfb87a711'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:48.484707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98d47b-6861-4690-975b-fd4b9f30aab2 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:48.488402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63df125-45cb-4038-9635-9270a225226d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:48.489043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df125-45cb-4038-9635-9270a225226d service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:48.489353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df125-45cb-4038-9635-9270a225226d service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:48.489599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df125-45cb-4038-9635-9270a225226d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:48.491429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c63df125-45cb-4038-9635-9270a225226d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:48.503310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63df125-45cb-4038-9635-9270a225226d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:48.504903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63df125-45cb-4038-9635-9270a225226d service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:48.515259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1228/2482] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:15:48.526059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1255/2483] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:48 2022] DELETE /identity/v3/users/d7d0ac59f19c4bafaa9d5a3bfb87a711 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:48.530452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11e5f-0a94-476e-905c-64740c0df19d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:48.530739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11e5f-0a94-476e-905c-64740c0df19d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:48.531017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11e5f-0a94-476e-905c-64740c0df19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:48.550069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-59d11e5f-0a94-476e-905c-64740c0df19d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:48.551314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-59d11e5f-0a94-476e-905c-64740c0df19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:48.609779 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1229/2484] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:48.619963 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:48.621449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:48.682753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2fd34-3868-4b93-80f9-ea5ac2341e05 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:48.690516 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2540ca-7c7d-4928-90bd-4a76a379d6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:48.691205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2540ca-7c7d-4928-90bd-4a76a379d6aa service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:48.691957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2540ca-7c7d-4928-90bd-4a76a379d6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:48.692269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2540ca-7c7d-4928-90bd-4a76a379d6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:48.706472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2540ca-7c7d-4928-90bd-4a76a379d6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:48.706472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2540ca-7c7d-4928-90bd-4a76a379d6aa service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:48.716580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1256/2485] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:49.461675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d11e5f-0a94-476e-905c-64740c0df19d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:49.463484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-59d11e5f-0a94-476e-905c-64740c0df19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:49.476205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d11e5f-0a94-476e-905c-64740c0df19d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:49.481330 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:49.481700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:49.481958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:49.482231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] PATH_INFO: `/v3/projects/4d30568e84a34c319de7c6ba1699826b` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:49.483412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d30568e84a34c319de7c6ba1699826b)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:49.485509 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:49.604462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d30568e84a34c319de7c6ba1699826b', 'request_id': 'req-5d8f8350-5525-4647-b41c-d4151783e5bf'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:49.610234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d30568e84a34c319de7c6ba1699826b', 'request_id': 'req-5d8f8350-5525-4647-b41c-d4151783e5bf'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:49.685131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d30568e84a34c319de7c6ba1699826b', 'request_id': 'req-5d8f8350-5525-4647-b41c-d4151783e5bf'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:49.697780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] The token cache is being invalidate because project 4d30568e84a34c319de7c6ba1699826b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:49.698210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:49.698860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5d8f8350-5525-4647-b41c-d4151783e5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:49.700402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1230/2486] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:49 2022] DELETE /identity/v3/projects/4d30568e84a34c319de7c6ba1699826b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:49.704491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2540ca-7c7d-4928-90bd-4a76a379d6aa service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:49.714341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2540ca-7c7d-4928-90bd-4a76a379d6aa service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:49.751543 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:49.779234 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:49.779879 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:49.780159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:49.780436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] PATH_INFO: `/v3/users/ecd2230d82434f3a86f36c3db16d8cbc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:49.781753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd2230d82434f3a86f36c3db16d8cbc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:49.783679 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:49.959173 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd2230d82434f3a86f36c3db16d8cbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:49.959909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd2230d82434f3a86f36c3db16d8cbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:49.967133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd2230d82434f3a86f36c3db16d8cbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:49.968084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd2230d82434f3a86f36c3db16d8cbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:49.980617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd2230d82434f3a86f36c3db16d8cbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:50.045234 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989379f-82fc-45f0-8194-dd42c8ff96ee None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.045522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989379f-82fc-45f0-8194-dd42c8ff96ee None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.045801 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989379f-82fc-45f0-8194-dd42c8ff96ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.059824 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:50.063975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1257/2487] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:49 2022] DELETE /identity/v3/users/ecd2230d82434f3a86f36c3db16d8cbc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:50.081201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-0989379f-82fc-45f0-8194-dd42c8ff96ee None None] MFA Rules not processed for user `624847b30f2e45679762c694e02d1e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:50.082930 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0989379f-82fc-45f0-8194-dd42c8ff96ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:50.164079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1231/2488] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:50.168664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:50.170422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:50.254267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986db880-0c4c-4967-b997-ea749c6c5324 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:50.262139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbffc73-7941-45b8-9080-d3ee0e94a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:50.267212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbffc73-7941-45b8-9080-d3ee0e94a83f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.267212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbffc73-7941-45b8-9080-d3ee0e94a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.267212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbffc73-7941-45b8-9080-d3ee0e94a83f admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.267212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbffc73-7941-45b8-9080-d3ee0e94a83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:50.267212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbffc73-7941-45b8-9080-d3ee0e94a83f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:50.344724 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1258/2489] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:50 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:50.346000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989379f-82fc-45f0-8194-dd42c8ff96ee None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:50.360246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989379f-82fc-45f0-8194-dd42c8ff96ee None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:50.426821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3058b-c294-4ebb-b99b-c9cc46d6363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:50.427572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3058b-c294-4ebb-b99b-c9cc46d6363f admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.427854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3058b-c294-4ebb-b99b-c9cc46d6363f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.428125 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3058b-c294-4ebb-b99b-c9cc46d6363f admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.429652 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3058b-c294-4ebb-b99b-c9cc46d6363f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:50.431585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3058b-c294-4ebb-b99b-c9cc46d6363f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:50.498871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbffc73-7941-45b8-9080-d3ee0e94a83f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:50.501066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0cbffc73-7941-45b8-9080-d3ee0e94a83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:50.525920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1232/2490] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:50 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:50.527574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3058b-c294-4ebb-b99b-c9cc46d6363f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:50.531070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbffc73-7941-45b8-9080-d3ee0e94a83f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:50.536674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:50.537431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.538429 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.538824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] PATH_INFO: `/v3/projects/e8f63935278d4717a92cb50d280dcb64` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.541126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f63935278d4717a92cb50d280dcb64)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:50.543311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:50.550166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3058b-c294-4ebb-b99b-c9cc46d6363f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:50.556999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdbb98-10b5-49c5-897e-4ef4baa36ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:50.557633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdbb98-10b5-49c5-897e-4ef4baa36ece admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.557917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdbb98-10b5-49c5-897e-4ef4baa36ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.558229 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdbb98-10b5-49c5-897e-4ef4baa36ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.558903 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdbb98-10b5-49c5-897e-4ef4baa36ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:50.560511 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdbb98-10b5-49c5-897e-4ef4baa36ece admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:50.581183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1233/2491] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:15:50.585226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdbb98-10b5-49c5-897e-4ef4baa36ece admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:50.596944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdbb98-10b5-49c5-897e-4ef4baa36ece admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:50.601852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac57ed-9d94-4cee-a100-06393e968a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:50.602512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac57ed-9d94-4cee-a100-06393e968a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.602792 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac57ed-9d94-4cee-a100-06393e968a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.603091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac57ed-9d94-4cee-a100-06393e968a7d admin admin] PATH_INFO: `/v3/projects/859ed04436754b4a949066785e254285/users/46cb662c14854235ad8fab6ed2eedd23/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.619054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac57ed-9d94-4cee-a100-06393e968a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=859ed04436754b4a949066785e254285, user_id=46cb662c14854235ad8fab6ed2eedd23, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:50.621745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac57ed-9d94-4cee-a100-06393e968a7d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:50.705825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1234/2492] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:50 2022] PUT /identity/v3/projects/859ed04436754b4a949066785e254285/users/46cb662c14854235ad8fab6ed2eedd23/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:50.707082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac57ed-9d94-4cee-a100-06393e968a7d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:50.722786 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f63935278d4717a92cb50d280dcb64', 'request_id': 'req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:50.775702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac57ed-9d94-4cee-a100-06393e968a7d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:50.828707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f63935278d4717a92cb50d280dcb64', 'request_id': 'req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:50.833709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919143a7-0136-4693-a2c0-7ac3dba3df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:50.834367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919143a7-0136-4693-a2c0-7ac3dba3df63 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.834650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919143a7-0136-4693-a2c0-7ac3dba3df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.834955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919143a7-0136-4693-a2c0-7ac3dba3df63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.844276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919143a7-0136-4693-a2c0-7ac3dba3df63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:50.844451 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f63935278d4717a92cb50d280dcb64', 'request_id': 'req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:50.844545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919143a7-0136-4693-a2c0-7ac3dba3df63 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:50.851158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1235/2493] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:50.852398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919143a7-0136-4693-a2c0-7ac3dba3df63 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:50.860994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] The token cache is being invalidate because project e8f63935278d4717a92cb50d280dcb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:50.861351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:50.862059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1a1d1cc8-db15-4c26-8960-abc9d84a1e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:50.862528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919143a7-0136-4693-a2c0-7ac3dba3df63 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:50.863718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1259/2494] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:50 2022] DELETE /identity/v3/projects/e8f63935278d4717a92cb50d280dcb64 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:50.867999 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a91253-a2e0-45b0-9762-2b8deeffea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:50.868659 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a91253-a2e0-45b0-9762-2b8deeffea1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.868975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a91253-a2e0-45b0-9762-2b8deeffea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.869176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5510-1b00-433b-b838-fc34263a1a7e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.869282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a91253-a2e0-45b0-9762-2b8deeffea1a admin admin] PATH_INFO: `/v3/projects/859ed04436754b4a949066785e254285/users/46cb662c14854235ad8fab6ed2eedd23/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.869454 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5510-1b00-433b-b838-fc34263a1a7e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.869919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5510-1b00-433b-b838-fc34263a1a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.871336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a91253-a2e0-45b0-9762-2b8deeffea1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=859ed04436754b4a949066785e254285, user_id=46cb662c14854235ad8fab6ed2eedd23, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:50.875255 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a91253-a2e0-45b0-9762-2b8deeffea1a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:50.885771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1236/2495] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:50 2022] PUT /identity/v3/projects/859ed04436754b4a949066785e254285/users/46cb662c14854235ad8fab6ed2eedd23/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:50.889641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4e4e5510-1b00-433b-b838-fc34263a1a7e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:50.890737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4e4e5510-1b00-433b-b838-fc34263a1a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:50.951645 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1260/2496] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:50.959534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e3bd-8e43-419c-b6d1-62a70a5c1def None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:50.959901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e3bd-8e43-419c-b6d1-62a70a5c1def None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:50.960187 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e3bd-8e43-419c-b6d1-62a70a5c1def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:50.981399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7345e3bd-8e43-419c-b6d1-62a70a5c1def None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:50.982736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7345e3bd-8e43-419c-b6d1-62a70a5c1def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:50.992210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1237/2497] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:50.996316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e5510-1b00-433b-b838-fc34263a1a7e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:51.006522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e5510-1b00-433b-b838-fc34263a1a7e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:51.011442 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94037d0-c2cf-4251-bbbd-52039a0a99ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:51.012062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94037d0-c2cf-4251-bbbd-52039a0a99ba admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:51.012344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94037d0-c2cf-4251-bbbd-52039a0a99ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:51.012618 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94037d0-c2cf-4251-bbbd-52039a0a99ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:51.013370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94037d0-c2cf-4251-bbbd-52039a0a99ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:51.013673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94037d0-c2cf-4251-bbbd-52039a0a99ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:51.015260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94037d0-c2cf-4251-bbbd-52039a0a99ba admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:51.027259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1261/2498] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:15:51.031704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e3bd-8e43-419c-b6d1-62a70a5c1def None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:51.041748 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e3bd-8e43-419c-b6d1-62a70a5c1def None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:51.046500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46531f-f408-47f0-849e-70141fcc44f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:51.047100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46531f-f408-47f0-849e-70141fcc44f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:51.056348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46531f-f408-47f0-849e-70141fcc44f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:51.056348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46531f-f408-47f0-849e-70141fcc44f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:51.056348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46531f-f408-47f0-849e-70141fcc44f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:51.056348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46531f-f408-47f0-849e-70141fcc44f4 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:51.435821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1238/2499] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:51 2022] POST /identity/v3/projects => generated 365 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:51.440974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94037d0-c2cf-4251-bbbd-52039a0a99ba admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:51.450548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94037d0-c2cf-4251-bbbd-52039a0a99ba admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:51.484615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:51.514176 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df50e0-70ab-4c3c-8137-6c57495ca921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:51.514822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df50e0-70ab-4c3c-8137-6c57495ca921 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:51.515099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df50e0-70ab-4c3c-8137-6c57495ca921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:51.515372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df50e0-70ab-4c3c-8137-6c57495ca921 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:51.516043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df50e0-70ab-4c3c-8137-6c57495ca921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:51.517991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df50e0-70ab-4c3c-8137-6c57495ca921 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:51.645786 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1262/2500] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:51 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:51.650104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46531f-f408-47f0-849e-70141fcc44f4 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:51.660120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46531f-f408-47f0-849e-70141fcc44f4 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:51.665158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93838520-5cb7-4f75-911d-89c4eb9869fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:51.665783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93838520-5cb7-4f75-911d-89c4eb9869fe admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:51.666056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93838520-5cb7-4f75-911d-89c4eb9869fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:51.666322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93838520-5cb7-4f75-911d-89c4eb9869fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:51.667019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93838520-5cb7-4f75-911d-89c4eb9869fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:51.668597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93838520-5cb7-4f75-911d-89c4eb9869fe admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:51.678956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1239/2501] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:51.685249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df50e0-70ab-4c3c-8137-6c57495ca921 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:51.695490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df50e0-70ab-4c3c-8137-6c57495ca921 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:51.700111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cba7d7-9b46-4718-a2b8-b4b44138202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:51.700722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cba7d7-9b46-4718-a2b8-b4b44138202f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:51.701021 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cba7d7-9b46-4718-a2b8-b4b44138202f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:51.701299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cba7d7-9b46-4718-a2b8-b4b44138202f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:51.701994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cba7d7-9b46-4718-a2b8-b4b44138202f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:51.703582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cba7d7-9b46-4718-a2b8-b4b44138202f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:51.714167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:51.714824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1263/2502] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:51.718739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93838520-5cb7-4f75-911d-89c4eb9869fe admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:51.729161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93838520-5cb7-4f75-911d-89c4eb9869fe admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:51.733795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07c956-66c4-4977-a12e-959d95c27967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:51.734464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07c956-66c4-4977-a12e-959d95c27967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:51.734736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07c956-66c4-4977-a12e-959d95c27967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:51.735008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07c956-66c4-4977-a12e-959d95c27967 admin admin] PATH_INFO: `/v3/projects/9912d5249b6e46daa345482185e9fd83/users/b8ef335977254119a1446d9f08475db3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:51.753014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07c956-66c4-4977-a12e-959d95c27967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9912d5249b6e46daa345482185e9fd83, user_id=b8ef335977254119a1446d9f08475db3, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:51.757198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07c956-66c4-4977-a12e-959d95c27967 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:51.874624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1240/2503] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:51 2022] PUT /identity/v3/projects/9912d5249b6e46daa345482185e9fd83/users/b8ef335977254119a1446d9f08475db3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:51.886457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba5939-e495-4b71-bdea-d91f8f7ab336 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:51.887023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba5939-e495-4b71-bdea-d91f8f7ab336 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:51.887124 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba5939-e495-4b71-bdea-d91f8f7ab336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:51.917083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-17ba5939-e495-4b71-bdea-d91f8f7ab336 None None] MFA Rules not processed for user `b8ef335977254119a1446d9f08475db3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:51.918495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-17ba5939-e495-4b71-bdea-d91f8f7ab336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:51.990614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1264/2504] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:51.993974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07c956-66c4-4977-a12e-959d95c27967 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.059409 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07c956-66c4-4977-a12e-959d95c27967 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:52.064204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238486a-2121-4be3-afca-537fd809d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:52.064849 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238486a-2121-4be3-afca-537fd809d8ad admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.065132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238486a-2121-4be3-afca-537fd809d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.065405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238486a-2121-4be3-afca-537fd809d8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.066116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238486a-2121-4be3-afca-537fd809d8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:52.068017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238486a-2121-4be3-afca-537fd809d8ad admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.175402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1241/2505] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:51 2022] POST /identity/v3/projects => generated 363 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:52.180301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba5939-e495-4b71-bdea-d91f8f7ab336 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.191087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba5939-e495-4b71-bdea-d91f8f7ab336 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:52.246414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684377f7-6a58-453f-b8e4-de60bb007439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:52.246958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684377f7-6a58-453f-b8e4-de60bb007439 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.247242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684377f7-6a58-453f-b8e4-de60bb007439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.247514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684377f7-6a58-453f-b8e4-de60bb007439 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.248181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684377f7-6a58-453f-b8e4-de60bb007439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:52.250133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684377f7-6a58-453f-b8e4-de60bb007439 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.371456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1265/2506] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:52 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:52.375437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238486a-2121-4be3-afca-537fd809d8ad admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.385881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238486a-2121-4be3-afca-537fd809d8ad admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:52.390518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f07951-4483-4f4d-841f-55c4b268340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:52.391124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f07951-4483-4f4d-841f-55c4b268340e admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.391398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f07951-4483-4f4d-841f-55c4b268340e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.391665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f07951-4483-4f4d-841f-55c4b268340e admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.392498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f07951-4483-4f4d-841f-55c4b268340e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:52.394116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f07951-4483-4f4d-841f-55c4b268340e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.404795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1242/2507] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:52.413092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684377f7-6a58-453f-b8e4-de60bb007439 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.423570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684377f7-6a58-453f-b8e4-de60bb007439 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:52.439058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72711efe-8bca-407b-b4c2-8bab52a23238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:52.439058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711efe-8bca-407b-b4c2-8bab52a23238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.439058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711efe-8bca-407b-b4c2-8bab52a23238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.439058 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711efe-8bca-407b-b4c2-8bab52a23238 admin admin] PATH_INFO: `/v3/projects/39999182f43c49a2af024ff7a9c6bc6b/users/64ffa7dc514f489eb5b9c9d92c7a85c9/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.444989 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72711efe-8bca-407b-b4c2-8bab52a23238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39999182f43c49a2af024ff7a9c6bc6b, user_id=64ffa7dc514f489eb5b9c9d92c7a85c9, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:52.447621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72711efe-8bca-407b-b4c2-8bab52a23238 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.550540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1266/2508] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:52 2022] PUT /identity/v3/projects/39999182f43c49a2af024ff7a9c6bc6b/users/64ffa7dc514f489eb5b9c9d92c7a85c9/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:52.554884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f07951-4483-4f4d-841f-55c4b268340e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.565375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f07951-4483-4f4d-841f-55c4b268340e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:52.622419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba237-55b1-42e8-bb22-df9b5ce78a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:52.623034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba237-55b1-42e8-bb22-df9b5ce78a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.623311 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba237-55b1-42e8-bb22-df9b5ce78a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.623582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba237-55b1-42e8-bb22-df9b5ce78a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.624315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ba237-55b1-42e8-bb22-df9b5ce78a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:52.625940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ba237-55b1-42e8-bb22-df9b5ce78a0b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.636508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1243/2509] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:52.640839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72711efe-8bca-407b-b4c2-8bab52a23238 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.657668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72711efe-8bca-407b-b4c2-8bab52a23238 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:52.657777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149042f0-74fa-4462-b375-97e803268a42 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.657777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149042f0-74fa-4462-b375-97e803268a42 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.657777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149042f0-74fa-4462-b375-97e803268a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.658353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d143932-0de5-4219-a6c7-1f261966880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:52.658353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d143932-0de5-4219-a6c7-1f261966880c admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.658353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d143932-0de5-4219-a6c7-1f261966880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.658353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d143932-0de5-4219-a6c7-1f261966880c admin admin] PATH_INFO: `/v3/projects/39999182f43c49a2af024ff7a9c6bc6b/users/64ffa7dc514f489eb5b9c9d92c7a85c9/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.659720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d143932-0de5-4219-a6c7-1f261966880c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39999182f43c49a2af024ff7a9c6bc6b, user_id=64ffa7dc514f489eb5b9c9d92c7a85c9, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:52.662433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d143932-0de5-4219-a6c7-1f261966880c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.683628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1267/2510] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:52 2022] PUT /identity/v3/projects/39999182f43c49a2af024ff7a9c6bc6b/users/64ffa7dc514f489eb5b9c9d92c7a85c9/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:52.684432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:52.684432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-149042f0-74fa-4462-b375-97e803268a42 None None] MFA Rules not processed for user `46cb662c14854235ad8fab6ed2eedd23`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:52.698008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-149042f0-74fa-4462-b375-97e803268a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:52.698205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d04bc-3744-4300-869c-246089cedc15 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.698205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d04bc-3744-4300-869c-246089cedc15 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.698205 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d04bc-3744-4300-869c-246089cedc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.718972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-275d04bc-3744-4300-869c-246089cedc15 None None] MFA Rules not processed for user `64ffa7dc514f489eb5b9c9d92c7a85c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:52.720189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-275d04bc-3744-4300-869c-246089cedc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:52.765346 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1244/2511] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:52.793911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1268/2512] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:52.806905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:52.817182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149042f0-74fa-4462-b375-97e803268a42 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.820244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-149042f0-74fa-4462-b375-97e803268a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:52.839675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc780097-3f51-43f6-986a-b3e153f46945 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.840289 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc780097-3f51-43f6-986a-b3e153f46945 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.840672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc780097-3f51-43f6-986a-b3e153f46945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.862083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dc780097-3f51-43f6-986a-b3e153f46945 None None] MFA Rules not processed for user `624847b30f2e45679762c694e02d1e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:52.863316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dc780097-3f51-43f6-986a-b3e153f46945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:52.894309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149042f0-74fa-4462-b375-97e803268a42 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:52.898267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592bac6-96dc-4fd8-a1a1-88dcddd2492b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:52.898878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592bac6-96dc-4fd8-a1a1-88dcddd2492b service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:52.899155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592bac6-96dc-4fd8-a1a1-88dcddd2492b service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:52.899423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592bac6-96dc-4fd8-a1a1-88dcddd2492b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:52.908768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592bac6-96dc-4fd8-a1a1-88dcddd2492b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:52.910280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592bac6-96dc-4fd8-a1a1-88dcddd2492b service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:52.918688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1269/2513] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:52.920835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1245/2514] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:52.938987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc780097-3f51-43f6-986a-b3e153f46945 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:52.938987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dc780097-3f51-43f6-986a-b3e153f46945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:53.012819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc780097-3f51-43f6-986a-b3e153f46945 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.018330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2172f5-77f1-48da-9ab7-42ab5b4f6a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.018945 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2172f5-77f1-48da-9ab7-42ab5b4f6a5c service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.019226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2172f5-77f1-48da-9ab7-42ab5b4f6a5c service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.019498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2172f5-77f1-48da-9ab7-42ab5b4f6a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.021441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2c2172f5-77f1-48da-9ab7-42ab5b4f6a5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:53.031846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2172f5-77f1-48da-9ab7-42ab5b4f6a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:53.033530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2172f5-77f1-48da-9ab7-42ab5b4f6a5c service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:53.043182 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1270/2515] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:53.884429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592bac6-96dc-4fd8-a1a1-88dcddd2492b service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:53.885976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9592bac6-96dc-4fd8-a1a1-88dcddd2492b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:53.912449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:53.916774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2172f5-77f1-48da-9ab7-42ab5b4f6a5c service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:53.952599 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592bac6-96dc-4fd8-a1a1-88dcddd2492b service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.956701 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf10b34-adff-4165-a1f7-2834ce1323aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.957442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf10b34-adff-4165-a1f7-2834ce1323aa service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.957821 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf10b34-adff-4165-a1f7-2834ce1323aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.958433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf10b34-adff-4165-a1f7-2834ce1323aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.960463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-baf10b34-adff-4165-a1f7-2834ce1323aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:53.980571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2172f5-77f1-48da-9ab7-42ab5b4f6a5c service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:53.985349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:53.985994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:53.986321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:53.986600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] PATH_INFO: `/v3/users/b8ef335977254119a1446d9f08475db3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:53.987804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ef335977254119a1446d9f08475db3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:53.989912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:54.027289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf10b34-adff-4165-a1f7-2834ce1323aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:54.028767 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf10b34-adff-4165-a1f7-2834ce1323aa service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:54.039095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1246/2516] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:54.213123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ef335977254119a1446d9f08475db3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:54.213987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ef335977254119a1446d9f08475db3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:54.222332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ef335977254119a1446d9f08475db3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:54.233303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ef335977254119a1446d9f08475db3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:54.247120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ef335977254119a1446d9f08475db3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:54.291075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:54.365075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1271/2517] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:53 2022] DELETE /identity/v3/users/b8ef335977254119a1446d9f08475db3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:15:54.371256 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74669fc-3e1a-4fe4-a4e4-623327e60b8a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:54.371612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74669fc-3e1a-4fe4-a4e4-623327e60b8a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:54.371960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74669fc-3e1a-4fe4-a4e4-623327e60b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:54.391958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a74669fc-3e1a-4fe4-a4e4-623327e60b8a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:54.393350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a74669fc-3e1a-4fe4-a4e4-623327e60b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:54.455027 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1247/2518] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:54.465850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:54.468848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:54.525070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cab74-48a9-4f45-9b29-75ddabada0d5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:54.528792 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda26fc8-3c66-43c7-b6fa-0213d5a01f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:54.529431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda26fc8-3c66-43c7-b6fa-0213d5a01f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:54.529705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda26fc8-3c66-43c7-b6fa-0213d5a01f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:54.529972 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda26fc8-3c66-43c7-b6fa-0213d5a01f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:54.539260 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda26fc8-3c66-43c7-b6fa-0213d5a01f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:54.540794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda26fc8-3c66-43c7-b6fa-0213d5a01f28 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:54.550860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1272/2519] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:55.236538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74669fc-3e1a-4fe4-a4e4-623327e60b8a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:55.238057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a74669fc-3e1a-4fe4-a4e4-623327e60b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:55.251561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74669fc-3e1a-4fe4-a4e4-623327e60b8a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:55.256696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:55.257556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:55.257942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:55.258321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] PATH_INFO: `/v3/projects/9912d5249b6e46daa345482185e9fd83` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:55.259585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9912d5249b6e46daa345482185e9fd83)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:55.272726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:55.435915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9912d5249b6e46daa345482185e9fd83', 'request_id': 'req-964c07f8-f45d-463e-bc30-5152b4e69f0b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:55.441626 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:55.443553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9912d5249b6e46daa345482185e9fd83', 'request_id': 'req-964c07f8-f45d-463e-bc30-5152b4e69f0b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:55.448287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:55.519502 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9912d5249b6e46daa345482185e9fd83', 'request_id': 'req-964c07f8-f45d-463e-bc30-5152b4e69f0b'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:55.534523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] The token cache is being invalidate because project 9912d5249b6e46daa345482185e9fd83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:55.534928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:55.535581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:55.537155 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1248/2520] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:55 2022] DELETE /identity/v3/projects/9912d5249b6e46daa345482185e9fd83 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:55.541804 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda26fc8-3c66-43c7-b6fa-0213d5a01f28 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:55.551624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda26fc8-3c66-43c7-b6fa-0213d5a01f28 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:55.609036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:55.614646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:55.614646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:55.614646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] PATH_INFO: `/v3/users/64ffa7dc514f489eb5b9c9d92c7a85c9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:55.614646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ffa7dc514f489eb5b9c9d92c7a85c9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:55.614646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:55.952812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ffa7dc514f489eb5b9c9d92c7a85c9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:55.953426 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ffa7dc514f489eb5b9c9d92c7a85c9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:55.961111 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ffa7dc514f489eb5b9c9d92c7a85c9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:55.962933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ffa7dc514f489eb5b9c9d92c7a85c9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:55.974756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-95e07362-4c91-40f8-b97c-e4d5ee9edd83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ffa7dc514f489eb5b9c9d92c7a85c9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:56.046716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1273/2521] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:55 2022] DELETE /identity/v3/users/64ffa7dc514f489eb5b9c9d92c7a85c9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:56.442994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:56.576095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:56.578617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:56.593528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c07f8-f45d-463e-bc30-5152b4e69f0b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:56.666074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:56.666716 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:56.666992 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:56.667264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] PATH_INFO: `/v3/projects/39999182f43c49a2af024ff7a9c6bc6b` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:56.668440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39999182f43c49a2af024ff7a9c6bc6b)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:56.670384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:56.763175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39999182f43c49a2af024ff7a9c6bc6b', 'request_id': 'req-42c958c3-2e70-4178-9a92-90daf6492932'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:56.770920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39999182f43c49a2af024ff7a9c6bc6b', 'request_id': 'req-42c958c3-2e70-4178-9a92-90daf6492932'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:56.840848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39999182f43c49a2af024ff7a9c6bc6b', 'request_id': 'req-42c958c3-2e70-4178-9a92-90daf6492932'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:56.865796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] The token cache is being invalidate because project 39999182f43c49a2af024ff7a9c6bc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:15:56.865796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:56.865796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-42c958c3-2e70-4178-9a92-90daf6492932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:56.875764 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1249/2522] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:15:56 2022] DELETE /identity/v3/projects/39999182f43c49a2af024ff7a9c6bc6b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:56.877568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217a1c-c545-49fe-9211-d7ee74d68078 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:56.877950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217a1c-c545-49fe-9211-d7ee74d68078 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:56.879921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01217a1c-c545-49fe-9211-d7ee74d68078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:56.903463 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-01217a1c-c545-49fe-9211-d7ee74d68078 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:56.904820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-01217a1c-c545-49fe-9211-d7ee74d68078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:56.985694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1274/2523] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:15:56.993840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afeaed-2d53-447d-b240-553a44102b92 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:56.994038 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afeaed-2d53-447d-b240-553a44102b92 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:56.994315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afeaed-2d53-447d-b240-553a44102b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:57.022112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f4afeaed-2d53-447d-b240-553a44102b92 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:57.024349 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f4afeaed-2d53-447d-b240-553a44102b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:57.037516 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1250/2524] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:57.042186 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01217a1c-c545-49fe-9211-d7ee74d68078 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:57.052640 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01217a1c-c545-49fe-9211-d7ee74d68078 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:57.059053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48803a8-b121-4def-a096-efa1c54b8185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:57.059798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48803a8-b121-4def-a096-efa1c54b8185 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:57.060184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48803a8-b121-4def-a096-efa1c54b8185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:57.060553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48803a8-b121-4def-a096-efa1c54b8185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:57.061403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48803a8-b121-4def-a096-efa1c54b8185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:15:57.065017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48803a8-b121-4def-a096-efa1c54b8185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:57.066720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48803a8-b121-4def-a096-efa1c54b8185 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:57.083296 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1275/2525] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:15:57.084597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afeaed-2d53-447d-b240-553a44102b92 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:57.097555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afeaed-2d53-447d-b240-553a44102b92 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:57.109047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a8da9-6aa3-4abf-8a04-75fc9888e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:57.109670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a8da9-6aa3-4abf-8a04-75fc9888e12a admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:57.109950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a8da9-6aa3-4abf-8a04-75fc9888e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:57.110222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a8da9-6aa3-4abf-8a04-75fc9888e12a admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:57.110900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a8da9-6aa3-4abf-8a04-75fc9888e12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:57.112958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a8da9-6aa3-4abf-8a04-75fc9888e12a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:57.332827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1251/2526] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:57 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:57.337198 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48803a8-b121-4def-a096-efa1c54b8185 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:57.349706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48803a8-b121-4def-a096-efa1c54b8185 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:57.446247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213db8e9-03cb-4e0a-92c5-d6234aa2d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:57.446247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213db8e9-03cb-4e0a-92c5-d6234aa2d4fb admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:57.446247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213db8e9-03cb-4e0a-92c5-d6234aa2d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:57.446247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213db8e9-03cb-4e0a-92c5-d6234aa2d4fb admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:57.447781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213db8e9-03cb-4e0a-92c5-d6234aa2d4fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:57.449785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213db8e9-03cb-4e0a-92c5-d6234aa2d4fb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:57.578946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1276/2527] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:57 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:15:57.586724 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a8da9-6aa3-4abf-8a04-75fc9888e12a admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:57.597676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a8da9-6aa3-4abf-8a04-75fc9888e12a admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:57.603799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec6678-cb07-4ab0-863e-f4794c9ddeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:57.604405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec6678-cb07-4ab0-863e-f4794c9ddeee admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:57.604684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec6678-cb07-4ab0-863e-f4794c9ddeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:57.604987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec6678-cb07-4ab0-863e-f4794c9ddeee admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:57.605682 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec6678-cb07-4ab0-863e-f4794c9ddeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:57.607332 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec6678-cb07-4ab0-863e-f4794c9ddeee admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:57.618799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1252/2528] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:57.622614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213db8e9-03cb-4e0a-92c5-d6234aa2d4fb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:57.636455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213db8e9-03cb-4e0a-92c5-d6234aa2d4fb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:57.644244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beb80f-18ba-455d-a0e0-bffc85f45bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:57.644915 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb80f-18ba-455d-a0e0-bffc85f45bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:57.645197 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb80f-18ba-455d-a0e0-bffc85f45bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:57.645476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb80f-18ba-455d-a0e0-bffc85f45bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:57.646328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beb80f-18ba-455d-a0e0-bffc85f45bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:57.648431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beb80f-18ba-455d-a0e0-bffc85f45bc2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:57.661668 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1277/2529] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:57.666766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec6678-cb07-4ab0-863e-f4794c9ddeee admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:57.681147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec6678-cb07-4ab0-863e-f4794c9ddeee admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:57.686711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e948f-0447-4bfc-8d90-957d909288e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:57.688160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e948f-0447-4bfc-8d90-957d909288e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:57.688160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e948f-0447-4bfc-8d90-957d909288e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:57.688160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e948f-0447-4bfc-8d90-957d909288e3 admin admin] PATH_INFO: `/v3/projects/8ed9aaa0533549cb8a8b5651d81a43ab/users/e75ec9b39ca54c8e82f5568a7de6ce24/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:57.703825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e948f-0447-4bfc-8d90-957d909288e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed9aaa0533549cb8a8b5651d81a43ab, user_id=e75ec9b39ca54c8e82f5568a7de6ce24, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:57.706737 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e948f-0447-4bfc-8d90-957d909288e3 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:57.845782 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1253/2530] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:57 2022] PUT /identity/v3/projects/8ed9aaa0533549cb8a8b5651d81a43ab/users/e75ec9b39ca54c8e82f5568a7de6ce24/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:57.861677 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191328f-9b81-4c94-bdd2-ba8f45d0e850 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:57.861952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191328f-9b81-4c94-bdd2-ba8f45d0e850 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:57.862222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191328f-9b81-4c94-bdd2-ba8f45d0e850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:57.890395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6191328f-9b81-4c94-bdd2-ba8f45d0e850 None None] MFA Rules not processed for user `e75ec9b39ca54c8e82f5568a7de6ce24`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:57.894916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6191328f-9b81-4c94-bdd2-ba8f45d0e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:57.976856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1278/2531] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:57.981419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e948f-0447-4bfc-8d90-957d909288e3 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:58.001344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:58.039631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:58.045513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e948f-0447-4bfc-8d90-957d909288e3 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:58.050249 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cfdf9-afef-4b58-9864-b83475d697c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:58.050848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cfdf9-afef-4b58-9864-b83475d697c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:58.051125 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cfdf9-afef-4b58-9864-b83475d697c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:58.051398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cfdf9-afef-4b58-9864-b83475d697c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:58.052055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cfdf9-afef-4b58-9864-b83475d697c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:58.054519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cfdf9-afef-4b58-9864-b83475d697c1 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:58.178792 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1254/2532] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:15:57 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:58.186878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191328f-9b81-4c94-bdd2-ba8f45d0e850 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:58.194059 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191328f-9b81-4c94-bdd2-ba8f45d0e850 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:58.258066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53174ae-f473-4464-85c6-b62991752a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:58.258767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53174ae-f473-4464-85c6-b62991752a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:58.259062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53174ae-f473-4464-85c6-b62991752a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:58.259348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53174ae-f473-4464-85c6-b62991752a1c admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:58.260015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53174ae-f473-4464-85c6-b62991752a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:58.262105 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53174ae-f473-4464-85c6-b62991752a1c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:58.374779 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1279/2533] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:15:58 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:15:58.376136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cfdf9-afef-4b58-9864-b83475d697c1 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:58.387074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cfdf9-afef-4b58-9864-b83475d697c1 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:58.391634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d507d-83bd-40c4-be6b-babd2092fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:58.392269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d507d-83bd-40c4-be6b-babd2092fc38 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:58.392546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d507d-83bd-40c4-be6b-babd2092fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:58.392844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d507d-83bd-40c4-be6b-babd2092fc38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:58.393538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d507d-83bd-40c4-be6b-babd2092fc38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:58.396704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d507d-83bd-40c4-be6b-babd2092fc38 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:58.407656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1255/2534] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:58.412257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53174ae-f473-4464-85c6-b62991752a1c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:58.424032 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53174ae-f473-4464-85c6-b62991752a1c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:58.429971 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0d08e-a640-44d1-a776-7919af8ee642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:58.430647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0d08e-a640-44d1-a776-7919af8ee642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:58.430933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0d08e-a640-44d1-a776-7919af8ee642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:58.431212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0d08e-a640-44d1-a776-7919af8ee642 admin admin] PATH_INFO: `/v3/projects/8f85383ef5a24eb788c26f676bbb6081/users/f83085401ba64cd1bb33a5726ef30338/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:58.447714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0d08e-a640-44d1-a776-7919af8ee642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f85383ef5a24eb788c26f676bbb6081, user_id=f83085401ba64cd1bb33a5726ef30338, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:58.450418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0d08e-a640-44d1-a776-7919af8ee642 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:58.575641 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1280/2535] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:58 2022] PUT /identity/v3/projects/8f85383ef5a24eb788c26f676bbb6081/users/f83085401ba64cd1bb33a5726ef30338/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:58.578169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d507d-83bd-40c4-be6b-babd2092fc38 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:58.590124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d507d-83bd-40c4-be6b-babd2092fc38 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:58.679251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e68ca-8bd5-46f8-bcd9-b7a109853086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:58.695666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e68ca-8bd5-46f8-bcd9-b7a109853086 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:58.695666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e68ca-8bd5-46f8-bcd9-b7a109853086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:58.695666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e68ca-8bd5-46f8-bcd9-b7a109853086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:58.695666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e68ca-8bd5-46f8-bcd9-b7a109853086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:58.695666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e68ca-8bd5-46f8-bcd9-b7a109853086 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:58.695666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1256/2536] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:15:58.699106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0d08e-a640-44d1-a776-7919af8ee642 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:58.710754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0d08e-a640-44d1-a776-7919af8ee642 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:58.716229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94258470-ae16-4cc9-899d-ebbca3ea8d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:58.716936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94258470-ae16-4cc9-899d-ebbca3ea8d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:58.717221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94258470-ae16-4cc9-899d-ebbca3ea8d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:58.717491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94258470-ae16-4cc9-899d-ebbca3ea8d32 admin admin] PATH_INFO: `/v3/projects/8f85383ef5a24eb788c26f676bbb6081/users/f83085401ba64cd1bb33a5726ef30338/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:58.719875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94258470-ae16-4cc9-899d-ebbca3ea8d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f85383ef5a24eb788c26f676bbb6081, user_id=f83085401ba64cd1bb33a5726ef30338, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:58.722570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94258470-ae16-4cc9-899d-ebbca3ea8d32 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:58.734578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1281/2537] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:15:58 2022] PUT /identity/v3/projects/8f85383ef5a24eb788c26f676bbb6081/users/f83085401ba64cd1bb33a5726ef30338/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:58.745952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3989-66b4-42df-a2fa-303237a43a5c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:58.746621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3989-66b4-42df-a2fa-303237a43a5c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:58.747289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee3989-66b4-42df-a2fa-303237a43a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:58.787378 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-fbee3989-66b4-42df-a2fa-303237a43a5c None None] MFA Rules not processed for user `f83085401ba64cd1bb33a5726ef30338`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:58.803355 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-fbee3989-66b4-42df-a2fa-303237a43a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:58.861063 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1257/2538] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:58.872340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94258470-ae16-4cc9-899d-ebbca3ea8d32 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:58.874060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-94258470-ae16-4cc9-899d-ebbca3ea8d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:58.931318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94258470-ae16-4cc9-899d-ebbca3ea8d32 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:58.935077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20027481-06f7-40f6-aa2b-8174923f6500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:58.935763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20027481-06f7-40f6-aa2b-8174923f6500 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:58.936050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20027481-06f7-40f6-aa2b-8174923f6500 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:58.936324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20027481-06f7-40f6-aa2b-8174923f6500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:58.946374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20027481-06f7-40f6-aa2b-8174923f6500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:58.948148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20027481-06f7-40f6-aa2b-8174923f6500 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:58.958374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1282/2539] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:15:58.987754 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3989-66b4-42df-a2fa-303237a43a5c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:59.056830 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee3989-66b4-42df-a2fa-303237a43a5c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:59.061623 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:59.062266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:59.062549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:59.062956 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] PATH_INFO: `/v3/users/e75ec9b39ca54c8e82f5568a7de6ce24` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:59.064179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75ec9b39ca54c8e82f5568a7de6ce24)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:59.066208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:59.226132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:59.288965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75ec9b39ca54c8e82f5568a7de6ce24'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:59.289714 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75ec9b39ca54c8e82f5568a7de6ce24'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:59.359500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75ec9b39ca54c8e82f5568a7de6ce24'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:59.360130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75ec9b39ca54c8e82f5568a7de6ce24'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:59.372616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75ec9b39ca54c8e82f5568a7de6ce24'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:15:59.386676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1258/2540] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:15:58 2022] DELETE /identity/v3/users/e75ec9b39ca54c8e82f5568a7de6ce24 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:15:59.389777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a188fb-93b6-4b55-97ac-3c0a4b58d9dc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:59.390383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a188fb-93b6-4b55-97ac-3c0a4b58d9dc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:59.390666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a188fb-93b6-4b55-97ac-3c0a4b58d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:59.410592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-10a188fb-93b6-4b55-97ac-3c0a4b58d9dc None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:15:59.411810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-10a188fb-93b6-4b55-97ac-3c0a4b58d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:59.424600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:59.476312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1283/2541] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:15:59.485917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:15:59.489976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:15:59.549898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63021c97-b761-4ed0-b17f-901dc8bfb929 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:15:59.554231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561678f-49ba-43a0-8825-8a803c34f582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:15:59.555056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561678f-49ba-43a0-8825-8a803c34f582 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:15:59.555349 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561678f-49ba-43a0-8825-8a803c34f582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:15:59.555618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561678f-49ba-43a0-8825-8a803c34f582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:15:59.565449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561678f-49ba-43a0-8825-8a803c34f582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:15:59.569261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561678f-49ba-43a0-8825-8a803c34f582 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:15:59.585371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1259/2542] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:00.033359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a188fb-93b6-4b55-97ac-3c0a4b58d9dc None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:00.035338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-10a188fb-93b6-4b55-97ac-3c0a4b58d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:00.052274 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a188fb-93b6-4b55-97ac-3c0a4b58d9dc None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:00.057178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:00.057897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:00.058246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:00.058588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] PATH_INFO: `/v3/projects/8ed9aaa0533549cb8a8b5651d81a43ab` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:00.059851 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed9aaa0533549cb8a8b5651d81a43ab)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:00.062002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:00.211535 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed9aaa0533549cb8a8b5651d81a43ab', 'request_id': 'req-6aff0087-6baf-4a8c-9c7d-53362f7a0431'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.313687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed9aaa0533549cb8a8b5651d81a43ab', 'request_id': 'req-6aff0087-6baf-4a8c-9c7d-53362f7a0431'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.321170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed9aaa0533549cb8a8b5651d81a43ab', 'request_id': 'req-6aff0087-6baf-4a8c-9c7d-53362f7a0431'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.338598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] The token cache is being invalidate because project 8ed9aaa0533549cb8a8b5651d81a43ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:00.338889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.339561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.341425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1284/2543] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:00 2022] DELETE /identity/v3/projects/8ed9aaa0533549cb8a8b5651d81a43ab => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:00.345482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561678f-49ba-43a0-8825-8a803c34f582 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:00.356127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561678f-49ba-43a0-8825-8a803c34f582 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:00.389383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:00.415307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:00.415916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:00.416195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:00.416490 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] PATH_INFO: `/v3/users/f83085401ba64cd1bb33a5726ef30338` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:00.418121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83085401ba64cd1bb33a5726ef30338)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:00.420064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:00.623524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83085401ba64cd1bb33a5726ef30338'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.624132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83085401ba64cd1bb33a5726ef30338'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.730879 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83085401ba64cd1bb33a5726ef30338'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.731530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83085401ba64cd1bb33a5726ef30338'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.744678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-27f2aa78-6714-45f8-a4e3-0aa8a35506be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83085401ba64cd1bb33a5726ef30338'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:00.757947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1260/2544] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:00 2022] DELETE /identity/v3/users/f83085401ba64cd1bb33a5726ef30338 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:01.219284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:01.224969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:01.234751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff0087-6baf-4a8c-9c7d-53362f7a0431 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:01.296990 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:01.297708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:01.297984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:01.298253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] PATH_INFO: `/v3/projects/8f85383ef5a24eb788c26f676bbb6081` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:01.299402 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f85383ef5a24eb788c26f676bbb6081)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:01.301486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:01.414196 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:01.417829 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f85383ef5a24eb788c26f676bbb6081', 'request_id': 'req-b673679e-844c-49fc-b942-451e8083f82e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:01.501754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f85383ef5a24eb788c26f676bbb6081', 'request_id': 'req-b673679e-844c-49fc-b942-451e8083f82e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:01.507987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f85383ef5a24eb788c26f676bbb6081', 'request_id': 'req-b673679e-844c-49fc-b942-451e8083f82e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:01.519320 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] The token cache is being invalidate because project 8f85383ef5a24eb788c26f676bbb6081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:01.519610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:01.520245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b673679e-844c-49fc-b942-451e8083f82e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:01.521844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1285/2545] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:01 2022] DELETE /identity/v3/projects/8f85383ef5a24eb788c26f676bbb6081 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:01.527180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625d6a-d141-4f16-88de-8c9480dd131b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:01.527669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625d6a-d141-4f16-88de-8c9480dd131b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:01.527950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625d6a-d141-4f16-88de-8c9480dd131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:01.547202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-82625d6a-d141-4f16-88de-8c9480dd131b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:01.548405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-82625d6a-d141-4f16-88de-8c9480dd131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:01.612227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1261/2546] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:01.620621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff19d1-4379-4627-98ac-ea91a99bedb6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:01.621084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff19d1-4379-4627-98ac-ea91a99bedb6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:01.621360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff19d1-4379-4627-98ac-ea91a99bedb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:01.643080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2cff19d1-4379-4627-98ac-ea91a99bedb6 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:01.644292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2cff19d1-4379-4627-98ac-ea91a99bedb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:01.652221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1286/2547] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:01.656455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625d6a-d141-4f16-88de-8c9480dd131b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:01.666104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625d6a-d141-4f16-88de-8c9480dd131b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:01.670725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5a154-560f-43c4-9f7c-68b0d45a6890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:01.671321 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5a154-560f-43c4-9f7c-68b0d45a6890 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:01.671602 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5a154-560f-43c4-9f7c-68b0d45a6890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:01.671873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5a154-560f-43c4-9f7c-68b0d45a6890 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:01.672562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5a154-560f-43c4-9f7c-68b0d45a6890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:01.672901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5a154-560f-43c4-9f7c-68b0d45a6890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:01.674496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5a154-560f-43c4-9f7c-68b0d45a6890 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:01.686370 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1262/2548] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:01.690438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff19d1-4379-4627-98ac-ea91a99bedb6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:01.700072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff19d1-4379-4627-98ac-ea91a99bedb6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:01.704708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143005b2-3282-4032-ae69-f0ed55e96b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:01.705346 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143005b2-3282-4032-ae69-f0ed55e96b16 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:01.705626 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143005b2-3282-4032-ae69-f0ed55e96b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:01.705897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143005b2-3282-4032-ae69-f0ed55e96b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:01.706559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143005b2-3282-4032-ae69-f0ed55e96b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:01.708431 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143005b2-3282-4032-ae69-f0ed55e96b16 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:01.834778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1287/2549] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:01 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:01.838815 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5a154-560f-43c4-9f7c-68b0d45a6890 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:01.849146 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5a154-560f-43c4-9f7c-68b0d45a6890 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:01.887446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:01.921510 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d640b8-e218-42df-92b6-10d66831f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:01.922130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d640b8-e218-42df-92b6-10d66831f2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:01.922413 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d640b8-e218-42df-92b6-10d66831f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:01.922690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d640b8-e218-42df-92b6-10d66831f2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:01.923358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d640b8-e218-42df-92b6-10d66831f2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:01.925847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d640b8-e218-42df-92b6-10d66831f2f9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:02.040162 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1263/2550] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:01 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:02.044268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143005b2-3282-4032-ae69-f0ed55e96b16 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:02.055878 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143005b2-3282-4032-ae69-f0ed55e96b16 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:02.060773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bc0f3-33cd-4fda-8b35-7288e34929db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:02.067649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bc0f3-33cd-4fda-8b35-7288e34929db admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:02.067649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bc0f3-33cd-4fda-8b35-7288e34929db admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:02.067649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bc0f3-33cd-4fda-8b35-7288e34929db admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:02.067649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bc0f3-33cd-4fda-8b35-7288e34929db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:02.067649 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bc0f3-33cd-4fda-8b35-7288e34929db admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:02.074961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1288/2551] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:02.079100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d640b8-e218-42df-92b6-10d66831f2f9 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:02.089298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d640b8-e218-42df-92b6-10d66831f2f9 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:02.094436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef61e9-8745-40f0-bafd-9ab44380ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:02.095066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef61e9-8745-40f0-bafd-9ab44380ca0b admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:02.095319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef61e9-8745-40f0-bafd-9ab44380ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:02.095597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef61e9-8745-40f0-bafd-9ab44380ca0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:02.096304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef61e9-8745-40f0-bafd-9ab44380ca0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:02.097918 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef61e9-8745-40f0-bafd-9ab44380ca0b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:02.109025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1264/2552] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:02.113407 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bc0f3-33cd-4fda-8b35-7288e34929db admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:02.124170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bc0f3-33cd-4fda-8b35-7288e34929db admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:02.128750 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf85b2-7a7d-4c7a-8bbc-e76dd4fac75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:02.129434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf85b2-7a7d-4c7a-8bbc-e76dd4fac75c admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:02.145115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf85b2-7a7d-4c7a-8bbc-e76dd4fac75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:02.145115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf85b2-7a7d-4c7a-8bbc-e76dd4fac75c admin admin] PATH_INFO: `/v3/projects/6574628e57394fc48bfa3094d2132f2f/users/ad5b7eeb5c0b483abe117ab791dffd4a/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:02.145115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf85b2-7a7d-4c7a-8bbc-e76dd4fac75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6574628e57394fc48bfa3094d2132f2f, user_id=ad5b7eeb5c0b483abe117ab791dffd4a, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:02.146952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf85b2-7a7d-4c7a-8bbc-e76dd4fac75c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:02.233949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1289/2553] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:02 2022] PUT /identity/v3/projects/6574628e57394fc48bfa3094d2132f2f/users/ad5b7eeb5c0b483abe117ab791dffd4a/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:02.245941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465b462-518b-473d-be9c-ccef8003dae9 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:02.246729 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465b462-518b-473d-be9c-ccef8003dae9 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:02.247078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465b462-518b-473d-be9c-ccef8003dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:02.277307 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9465b462-518b-473d-be9c-ccef8003dae9 None None] MFA Rules not processed for user `ad5b7eeb5c0b483abe117ab791dffd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:02.278570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9465b462-518b-473d-be9c-ccef8003dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:02.361567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1265/2554] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:02.367527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf85b2-7a7d-4c7a-8bbc-e76dd4fac75c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:02.434942 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf85b2-7a7d-4c7a-8bbc-e76dd4fac75c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:02.439815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9a263-0c99-443c-a8d4-b202d6997b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:02.440513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9a263-0c99-443c-a8d4-b202d6997b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:02.441298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9a263-0c99-443c-a8d4-b202d6997b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:02.441298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9a263-0c99-443c-a8d4-b202d6997b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:02.441830 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9a263-0c99-443c-a8d4-b202d6997b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:02.443811 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9a263-0c99-443c-a8d4-b202d6997b39 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:02.577346 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1290/2555] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:02 2022] POST /identity/v3/projects => generated 389 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:02.584218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465b462-518b-473d-be9c-ccef8003dae9 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:02.595505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465b462-518b-473d-be9c-ccef8003dae9 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:02.657852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0aee7-02cd-4ff1-9cdf-ad4fa306398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:02.658533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0aee7-02cd-4ff1-9cdf-ad4fa306398b admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:02.658884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0aee7-02cd-4ff1-9cdf-ad4fa306398b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:02.659188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0aee7-02cd-4ff1-9cdf-ad4fa306398b admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:02.659861 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0aee7-02cd-4ff1-9cdf-ad4fa306398b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:02.661854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0aee7-02cd-4ff1-9cdf-ad4fa306398b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:02.787920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1266/2556] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:02 2022] POST /identity/v3/users => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:02.792366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9a263-0c99-443c-a8d4-b202d6997b39 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:02.802683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9a263-0c99-443c-a8d4-b202d6997b39 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:02.808007 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0f766-a874-4678-9190-f9248079017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:02.808625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0f766-a874-4678-9190-f9248079017e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:02.808924 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0f766-a874-4678-9190-f9248079017e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:02.809852 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0f766-a874-4678-9190-f9248079017e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:02.810006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0f766-a874-4678-9190-f9248079017e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:02.811627 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0f766-a874-4678-9190-f9248079017e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:02.822548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1291/2557] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:02.826610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0aee7-02cd-4ff1-9cdf-ad4fa306398b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:02.836539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0aee7-02cd-4ff1-9cdf-ad4fa306398b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:02.841250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b832c-aeb7-4bec-bfde-5575d664f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:02.841898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b832c-aeb7-4bec-bfde-5575d664f6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:02.842179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b832c-aeb7-4bec-bfde-5575d664f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:02.846476 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b832c-aeb7-4bec-bfde-5575d664f6c4 admin admin] PATH_INFO: `/v3/projects/a0d9d209441c4682afa699e2538c91b1/users/8a0a66f9e01c433fbaceabd59561775a/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:02.858240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b832c-aeb7-4bec-bfde-5575d664f6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d9d209441c4682afa699e2538c91b1, user_id=8a0a66f9e01c433fbaceabd59561775a, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:02.860929 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b832c-aeb7-4bec-bfde-5575d664f6c4 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:02.931553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1267/2558] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:02 2022] PUT /identity/v3/projects/a0d9d209441c4682afa699e2538c91b1/users/8a0a66f9e01c433fbaceabd59561775a/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:02.935662 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0f766-a874-4678-9190-f9248079017e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:02.945288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0f766-a874-4678-9190-f9248079017e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:02.985719 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:03.001754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26596fe4-5f84-46c2-ba9f-38ceafbf2432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:03.002368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596fe4-5f84-46c2-ba9f-38ceafbf2432 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:03.002646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596fe4-5f84-46c2-ba9f-38ceafbf2432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:03.002919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596fe4-5f84-46c2-ba9f-38ceafbf2432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:03.003820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26596fe4-5f84-46c2-ba9f-38ceafbf2432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:03.005438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26596fe4-5f84-46c2-ba9f-38ceafbf2432 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:03.015292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1292/2559] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:03.019389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b832c-aeb7-4bec-bfde-5575d664f6c4 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:03.031120 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b832c-aeb7-4bec-bfde-5575d664f6c4 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:03.035934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bc088-ec96-4dd2-99fc-76c4896d46b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:03.036608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bc088-ec96-4dd2-99fc-76c4896d46b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:03.036925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bc088-ec96-4dd2-99fc-76c4896d46b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:03.037205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bc088-ec96-4dd2-99fc-76c4896d46b8 admin admin] PATH_INFO: `/v3/projects/a0d9d209441c4682afa699e2538c91b1/users/8a0a66f9e01c433fbaceabd59561775a/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:03.039253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bc088-ec96-4dd2-99fc-76c4896d46b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d9d209441c4682afa699e2538c91b1, user_id=8a0a66f9e01c433fbaceabd59561775a, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:03.042173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bc088-ec96-4dd2-99fc-76c4896d46b8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:03.048753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:03.053295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1268/2560] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:03 2022] PUT /identity/v3/projects/a0d9d209441c4682afa699e2538c91b1/users/8a0a66f9e01c433fbaceabd59561775a/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:03.064069 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eac38-1ded-48dd-aa70-add3fdd6d2a8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:03.064362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eac38-1ded-48dd-aa70-add3fdd6d2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:03.064638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eac38-1ded-48dd-aa70-add3fdd6d2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:03.092937 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-105eac38-1ded-48dd-aa70-add3fdd6d2a8 None None] MFA Rules not processed for user `8a0a66f9e01c433fbaceabd59561775a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:03.094164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-105eac38-1ded-48dd-aa70-add3fdd6d2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:03.160315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1293/2561] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:03.171374 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bc088-ec96-4dd2-99fc-76c4896d46b8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:03.173127 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-984bc088-ec96-4dd2-99fc-76c4896d46b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:03.231974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bc088-ec96-4dd2-99fc-76c4896d46b8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:03.236227 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba33696-81b6-4c64-82a1-27b0600c27db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:03.236901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba33696-81b6-4c64-82a1-27b0600c27db service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:03.237188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba33696-81b6-4c64-82a1-27b0600c27db service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:03.237486 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba33696-81b6-4c64-82a1-27b0600c27db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:03.246512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba33696-81b6-4c64-82a1-27b0600c27db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:03.247939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba33696-81b6-4c64-82a1-27b0600c27db service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:03.257394 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1269/2562] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:03.394933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eac38-1ded-48dd-aa70-add3fdd6d2a8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:03.464550 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eac38-1ded-48dd-aa70-add3fdd6d2a8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:03.471015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:03.472871 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:03.473329 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:03.473735 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] PATH_INFO: `/v3/users/ad5b7eeb5c0b483abe117ab791dffd4a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:03.475242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5b7eeb5c0b483abe117ab791dffd4a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:03.477245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:03.672101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5b7eeb5c0b483abe117ab791dffd4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:03.672754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5b7eeb5c0b483abe117ab791dffd4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:03.685326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5b7eeb5c0b483abe117ab791dffd4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:03.686009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5b7eeb5c0b483abe117ab791dffd4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:03.693222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:03.698776 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5b7eeb5c0b483abe117ab791dffd4a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:03.811043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1294/2563] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:03 2022] DELETE /identity/v3/users/ad5b7eeb5c0b483abe117ab791dffd4a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:03.815581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df722c-68a8-4be0-9975-47d7d643a38b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:03.816043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df722c-68a8-4be0-9975-47d7d643a38b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:03.816352 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df722c-68a8-4be0-9975-47d7d643a38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:03.835726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f6df722c-68a8-4be0-9975-47d7d643a38b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:03.841832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f6df722c-68a8-4be0-9975-47d7d643a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:03.895169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1270/2564] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:03.905340 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:03.906897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:03.966551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899dba0-de1d-46a5-8393-c22492ab8ad7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:03.970518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde6c5e-af43-4051-bcac-2bfb85857f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:03.971123 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde6c5e-af43-4051-bcac-2bfb85857f0a service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:03.977042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde6c5e-af43-4051-bcac-2bfb85857f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:03.977042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde6c5e-af43-4051-bcac-2bfb85857f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:03.981408 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde6c5e-af43-4051-bcac-2bfb85857f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:03.982820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde6c5e-af43-4051-bcac-2bfb85857f0a service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:03.993249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1295/2565] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:04.482095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df722c-68a8-4be0-9975-47d7d643a38b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:04.483674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f6df722c-68a8-4be0-9975-47d7d643a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:04.499065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df722c-68a8-4be0-9975-47d7d643a38b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:04.503886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:04.504660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:04.505064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:04.505464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] PATH_INFO: `/v3/projects/6574628e57394fc48bfa3094d2132f2f` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:04.506703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6574628e57394fc48bfa3094d2132f2f)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:04.508706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:04.646798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6574628e57394fc48bfa3094d2132f2f', 'request_id': 'req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:04.653011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6574628e57394fc48bfa3094d2132f2f', 'request_id': 'req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:04.747761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6574628e57394fc48bfa3094d2132f2f', 'request_id': 'req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:04.768567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] The token cache is being invalidate because project 6574628e57394fc48bfa3094d2132f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:04.769042 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:04.769981 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:04.771459 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1271/2566] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:04 2022] DELETE /identity/v3/projects/6574628e57394fc48bfa3094d2132f2f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:04.776330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde6c5e-af43-4051-bcac-2bfb85857f0a service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:04.791817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde6c5e-af43-4051-bcac-2bfb85857f0a service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:04.863437 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:04.864083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:04.864360 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:04.864632 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] PATH_INFO: `/v3/users/8a0a66f9e01c433fbaceabd59561775a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:04.865884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0a66f9e01c433fbaceabd59561775a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:04.867836 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:05.089224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0a66f9e01c433fbaceabd59561775a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.089865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0a66f9e01c433fbaceabd59561775a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.097195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0a66f9e01c433fbaceabd59561775a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.097855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0a66f9e01c433fbaceabd59561775a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.109865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4999b106-e763-4bbe-83e2-56eeb080bacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0a66f9e01c433fbaceabd59561775a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.188368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1296/2567] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:04 2022] DELETE /identity/v3/users/8a0a66f9e01c433fbaceabd59561775a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:05.614857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:05.617776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:05.634082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa7905-6155-4e90-9bb1-1bc4b96aeda8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:05.666178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:05.699780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:05.700425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:05.700704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:05.701032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] PATH_INFO: `/v3/projects/a0d9d209441c4682afa699e2538c91b1` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:05.702164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d9d209441c4682afa699e2538c91b1)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:05.704051 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:05.829927 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d9d209441c4682afa699e2538c91b1', 'request_id': 'req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.835707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d9d209441c4682afa699e2538c91b1', 'request_id': 'req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.931025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d9d209441c4682afa699e2538c91b1', 'request_id': 'req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.943124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] The token cache is being invalidate because project a0d9d209441c4682afa699e2538c91b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:05.943432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.944076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-28036efe-e1e1-4d7f-ab52-e1d907cf2eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:05.945660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1272/2568] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:05 2022] DELETE /identity/v3/projects/a0d9d209441c4682afa699e2538c91b1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:05.950460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8ee4-12c3-4677-81d7-15e760dd8a37 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:05.950979 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8ee4-12c3-4677-81d7-15e760dd8a37 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:05.960522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8ee4-12c3-4677-81d7-15e760dd8a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:05.960522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:05.971389 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-584d8ee4-12c3-4677-81d7-15e760dd8a37 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:05.972711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-584d8ee4-12c3-4677-81d7-15e760dd8a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:06.045875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1297/2569] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:06.054887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695e1ab-c418-4bcd-8cc6-3de5ba801066 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.055175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695e1ab-c418-4bcd-8cc6-3de5ba801066 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.055451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695e1ab-c418-4bcd-8cc6-3de5ba801066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.080968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b695e1ab-c418-4bcd-8cc6-3de5ba801066 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:06.081110 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b695e1ab-c418-4bcd-8cc6-3de5ba801066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:06.090735 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1273/2570] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:06.095486 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d8ee4-12c3-4677-81d7-15e760dd8a37 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:06.106043 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d8ee4-12c3-4677-81d7-15e760dd8a37 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:06.110643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac3ed1-32ec-4061-ac08-fdbfeade4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:06.111254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac3ed1-32ec-4061-ac08-fdbfeade4d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.111532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac3ed1-32ec-4061-ac08-fdbfeade4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.111803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac3ed1-32ec-4061-ac08-fdbfeade4d9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.113060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac3ed1-32ec-4061-ac08-fdbfeade4d9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:06.113361 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac3ed1-32ec-4061-ac08-fdbfeade4d9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:06.115010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac3ed1-32ec-4061-ac08-fdbfeade4d9c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:06.127435 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1298/2571] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:06.132011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695e1ab-c418-4bcd-8cc6-3de5ba801066 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:06.141183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695e1ab-c418-4bcd-8cc6-3de5ba801066 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:06.145908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f8fa3-ae56-4082-ab66-6ff5dc307124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:06.146544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f8fa3-ae56-4082-ab66-6ff5dc307124 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.146827 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f8fa3-ae56-4082-ab66-6ff5dc307124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.147100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f8fa3-ae56-4082-ab66-6ff5dc307124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.148297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f8fa3-ae56-4082-ab66-6ff5dc307124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:06.150315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f8fa3-ae56-4082-ab66-6ff5dc307124 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:06.223844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1274/2572] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:06 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:06.228671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac3ed1-32ec-4061-ac08-fdbfeade4d9c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:06.239561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac3ed1-32ec-4061-ac08-fdbfeade4d9c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:06.297071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32517336-0318-455a-ac64-2cbc370a3ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:06.297746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32517336-0318-455a-ac64-2cbc370a3ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.298030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32517336-0318-455a-ac64-2cbc370a3ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.298305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32517336-0318-455a-ac64-2cbc370a3ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.298981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32517336-0318-455a-ac64-2cbc370a3ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:06.300999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32517336-0318-455a-ac64-2cbc370a3ec9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:06.427834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1299/2573] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:06 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:06.432137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f8fa3-ae56-4082-ab66-6ff5dc307124 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:06.442561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f8fa3-ae56-4082-ab66-6ff5dc307124 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:06.447586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d52092-f8b7-4917-96cf-1de4d71a434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:06.448188 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d52092-f8b7-4917-96cf-1de4d71a434b admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.448472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d52092-f8b7-4917-96cf-1de4d71a434b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.448750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d52092-f8b7-4917-96cf-1de4d71a434b admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.449465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d52092-f8b7-4917-96cf-1de4d71a434b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:06.451148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d52092-f8b7-4917-96cf-1de4d71a434b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:06.461446 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1275/2574] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:06.465771 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32517336-0318-455a-ac64-2cbc370a3ec9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:06.477141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32517336-0318-455a-ac64-2cbc370a3ec9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:06.481762 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9090aa1-af6c-410a-9c20-f5425e6bf845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:06.482353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090aa1-af6c-410a-9c20-f5425e6bf845 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.482629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090aa1-af6c-410a-9c20-f5425e6bf845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.482900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9090aa1-af6c-410a-9c20-f5425e6bf845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.483635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9090aa1-af6c-410a-9c20-f5425e6bf845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:06.485247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9090aa1-af6c-410a-9c20-f5425e6bf845 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:06.496092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1300/2575] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:06.501591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d52092-f8b7-4917-96cf-1de4d71a434b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:06.511150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d52092-f8b7-4917-96cf-1de4d71a434b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:06.516015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0c2b-8727-4af0-893e-54829a18057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:06.516769 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0c2b-8727-4af0-893e-54829a18057d admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.517151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0c2b-8727-4af0-893e-54829a18057d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.517496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0c2b-8727-4af0-893e-54829a18057d admin admin] PATH_INFO: `/v3/projects/73f33e79b43d484f8b09be492bdaea63/users/d7d681dbaee0466d82f488c7355855d6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.535823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d0c2b-8727-4af0-893e-54829a18057d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f33e79b43d484f8b09be492bdaea63, user_id=d7d681dbaee0466d82f488c7355855d6, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:06.538548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d0c2b-8727-4af0-893e-54829a18057d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:06.610962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1276/2576] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:06 2022] PUT /identity/v3/projects/73f33e79b43d484f8b09be492bdaea63/users/d7d681dbaee0466d82f488c7355855d6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:06.677587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4acfc2-77ef-4ab2-be1b-6705dc927200 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.678030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4acfc2-77ef-4ab2-be1b-6705dc927200 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.678220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4acfc2-77ef-4ab2-be1b-6705dc927200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.714082 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4b4acfc2-77ef-4ab2-be1b-6705dc927200 None None] MFA Rules not processed for user `d7d681dbaee0466d82f488c7355855d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:06.715310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4b4acfc2-77ef-4ab2-be1b-6705dc927200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:06.792772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1301/2577] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:06.797445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0c2b-8727-4af0-893e-54829a18057d admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:06.861944 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0c2b-8727-4af0-893e-54829a18057d admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:06.866826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cce383-291a-48a3-9873-8f5496ae4da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:06.867439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cce383-291a-48a3-9873-8f5496ae4da2 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:06.867718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cce383-291a-48a3-9873-8f5496ae4da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:06.867991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cce383-291a-48a3-9873-8f5496ae4da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:06.868656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cce383-291a-48a3-9873-8f5496ae4da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:06.870633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cce383-291a-48a3-9873-8f5496ae4da2 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:07.001935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1277/2578] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:06 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:07.005881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4acfc2-77ef-4ab2-be1b-6705dc927200 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:07.019060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4acfc2-77ef-4ab2-be1b-6705dc927200 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:07.082910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9709e72-308d-4417-ab47-da6032a94c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:07.083562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9709e72-308d-4417-ab47-da6032a94c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:07.083815 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9709e72-308d-4417-ab47-da6032a94c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:07.084088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9709e72-308d-4417-ab47-da6032a94c33 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:07.084810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9709e72-308d-4417-ab47-da6032a94c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:07.086748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9709e72-308d-4417-ab47-da6032a94c33 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:07.206582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1302/2579] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:07 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:07.223997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cce383-291a-48a3-9873-8f5496ae4da2 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:07.235513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cce383-291a-48a3-9873-8f5496ae4da2 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:07.240265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29951b7d-d75b-4f85-8056-b65863bfabc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:07.240925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29951b7d-d75b-4f85-8056-b65863bfabc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:07.241758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29951b7d-d75b-4f85-8056-b65863bfabc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:07.242033 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29951b7d-d75b-4f85-8056-b65863bfabc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:07.242734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29951b7d-d75b-4f85-8056-b65863bfabc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:07.244430 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29951b7d-d75b-4f85-8056-b65863bfabc1 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:07.258022 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1278/2580] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:07.260806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9709e72-308d-4417-ab47-da6032a94c33 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:07.271538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9709e72-308d-4417-ab47-da6032a94c33 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:07.276554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0e842-d630-4875-b38f-9e36f39ce0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:07.277256 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0e842-d630-4875-b38f-9e36f39ce0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:07.277533 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0e842-d630-4875-b38f-9e36f39ce0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:07.277826 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0e842-d630-4875-b38f-9e36f39ce0c2 admin admin] PATH_INFO: `/v3/projects/05c85b11fc3349088649d4d5adadbcfc/users/80ce6885ff2140b3803cc588201ebcd4/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:07.293164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0e842-d630-4875-b38f-9e36f39ce0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c85b11fc3349088649d4d5adadbcfc, user_id=80ce6885ff2140b3803cc588201ebcd4, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:07.295833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0e842-d630-4875-b38f-9e36f39ce0c2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:07.440560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1303/2581] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:07 2022] PUT /identity/v3/projects/05c85b11fc3349088649d4d5adadbcfc/users/80ce6885ff2140b3803cc588201ebcd4/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:07.444865 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29951b7d-d75b-4f85-8056-b65863bfabc1 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:07.454878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29951b7d-d75b-4f85-8056-b65863bfabc1 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:07.510674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35319f-dca7-4ab0-8c5d-59ee2310b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:07.511287 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35319f-dca7-4ab0-8c5d-59ee2310b778 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:07.511568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35319f-dca7-4ab0-8c5d-59ee2310b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:07.511843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35319f-dca7-4ab0-8c5d-59ee2310b778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:07.512534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35319f-dca7-4ab0-8c5d-59ee2310b778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:07.514175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35319f-dca7-4ab0-8c5d-59ee2310b778 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:07.527715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1279/2582] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:07.529167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0e842-d630-4875-b38f-9e36f39ce0c2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:07.540610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0e842-d630-4875-b38f-9e36f39ce0c2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:07.546444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fa398-cd6b-4861-8880-bdc4ff8e5260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:07.547127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fa398-cd6b-4861-8880-bdc4ff8e5260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:07.547412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fa398-cd6b-4861-8880-bdc4ff8e5260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:07.547763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fa398-cd6b-4861-8880-bdc4ff8e5260 admin admin] PATH_INFO: `/v3/projects/05c85b11fc3349088649d4d5adadbcfc/users/80ce6885ff2140b3803cc588201ebcd4/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:07.553782 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fa398-cd6b-4861-8880-bdc4ff8e5260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c85b11fc3349088649d4d5adadbcfc, user_id=80ce6885ff2140b3803cc588201ebcd4, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:07.556466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fa398-cd6b-4861-8880-bdc4ff8e5260 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:07.572172 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1304/2583] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:07 2022] PUT /identity/v3/projects/05c85b11fc3349088649d4d5adadbcfc/users/80ce6885ff2140b3803cc588201ebcd4/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:07.581787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bde4fb-5da2-4dbd-8b0f-5581a7be15c1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:07.582077 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bde4fb-5da2-4dbd-8b0f-5581a7be15c1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:07.582359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bde4fb-5da2-4dbd-8b0f-5581a7be15c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:07.622447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:07.636347 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-72bde4fb-5da2-4dbd-8b0f-5581a7be15c1 None None] MFA Rules not processed for user `80ce6885ff2140b3803cc588201ebcd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:07.637673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-72bde4fb-5da2-4dbd-8b0f-5581a7be15c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:07.721034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1280/2584] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:07.731801 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fa398-cd6b-4861-8880-bdc4ff8e5260 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:07.733557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-456fa398-cd6b-4861-8880-bdc4ff8e5260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:07.801224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fa398-cd6b-4861-8880-bdc4ff8e5260 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:07.806772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cef792-5644-4788-9652-85c0dbc4be7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:07.807420 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef792-5644-4788-9652-85c0dbc4be7e service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:07.807700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef792-5644-4788-9652-85c0dbc4be7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:07.807973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef792-5644-4788-9652-85c0dbc4be7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:07.820300 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cef792-5644-4788-9652-85c0dbc4be7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:07.821865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cef792-5644-4788-9652-85c0dbc4be7e service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:07.832766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1305/2585] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:08.011179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:09.481611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bde4fb-5da2-4dbd-8b0f-5581a7be15c1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:09.551390 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bde4fb-5da2-4dbd-8b0f-5581a7be15c1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:09.556032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:09.556678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:09.556989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:09.557268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] PATH_INFO: `/v3/users/d7d681dbaee0466d82f488c7355855d6` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:09.558443 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d681dbaee0466d82f488c7355855d6)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:09.560376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:09.824006 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d681dbaee0466d82f488c7355855d6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:09.824662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d681dbaee0466d82f488c7355855d6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:09.926508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d681dbaee0466d82f488c7355855d6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:09.926508 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d681dbaee0466d82f488c7355855d6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:09.935417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d681dbaee0466d82f488c7355855d6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:09.948955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1281/2586] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:09 2022] DELETE /identity/v3/users/d7d681dbaee0466d82f488c7355855d6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:09.953516 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2100ac-2463-46dd-aa84-9c5a211c4347 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:09.954001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2100ac-2463-46dd-aa84-9c5a211c4347 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:09.954098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2100ac-2463-46dd-aa84-9c5a211c4347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:09.973514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fc2100ac-2463-46dd-aa84-9c5a211c4347 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:09.974737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fc2100ac-2463-46dd-aa84-9c5a211c4347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:10.028132 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:10.040600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1306/2587] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:10.050403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:10.051867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:10.110278 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c916166-3c36-44da-9786-3db29311ebfa admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:10.114216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824daa4-540c-4f47-ae2f-8f55442463e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:10.114831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824daa4-540c-4f47-ae2f-8f55442463e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:10.115117 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824daa4-540c-4f47-ae2f-8f55442463e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:10.115420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824daa4-540c-4f47-ae2f-8f55442463e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:10.125384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824daa4-540c-4f47-ae2f-8f55442463e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:10.126966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824daa4-540c-4f47-ae2f-8f55442463e6 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:10.137141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1282/2588] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:10.233731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:10.636230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2100ac-2463-46dd-aa84-9c5a211c4347 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:10.637128 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fc2100ac-2463-46dd-aa84-9c5a211c4347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:10.650098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2100ac-2463-46dd-aa84-9c5a211c4347 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:10.654897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:10.655860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:10.655983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:10.656253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] PATH_INFO: `/v3/projects/73f33e79b43d484f8b09be492bdaea63` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:10.657508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f33e79b43d484f8b09be492bdaea63)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:10.659917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:10.767228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f33e79b43d484f8b09be492bdaea63', 'request_id': 'req-e1f888bb-e49f-49a8-bf86-fb4d923670b3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:10.853614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f33e79b43d484f8b09be492bdaea63', 'request_id': 'req-e1f888bb-e49f-49a8-bf86-fb4d923670b3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:10.864112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f33e79b43d484f8b09be492bdaea63', 'request_id': 'req-e1f888bb-e49f-49a8-bf86-fb4d923670b3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:10.875993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] The token cache is being invalidate because project 73f33e79b43d484f8b09be492bdaea63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:10.876284 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:10.876985 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:10.883616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1307/2589] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:10 2022] DELETE /identity/v3/projects/73f33e79b43d484f8b09be492bdaea63 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:10.891609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824daa4-540c-4f47-ae2f-8f55442463e6 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:10.897649 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824daa4-540c-4f47-ae2f-8f55442463e6 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:10.959534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:10.960270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:10.960546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:10.960925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] PATH_INFO: `/v3/users/80ce6885ff2140b3803cc588201ebcd4` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:10.962289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ce6885ff2140b3803cc588201ebcd4)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:10.964756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:11.028189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:11.190922 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ce6885ff2140b3803cc588201ebcd4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:11.191607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ce6885ff2140b3803cc588201ebcd4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:11.239084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ce6885ff2140b3803cc588201ebcd4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:11.239792 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ce6885ff2140b3803cc588201ebcd4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:11.253175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ce6885ff2140b3803cc588201ebcd4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:11.265417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1283/2590] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:10 2022] DELETE /identity/v3/users/80ce6885ff2140b3803cc588201ebcd4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:11.795997 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:11.797567 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:11.813244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f888bb-e49f-49a8-bf86-fb4d923670b3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:11.878315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:11.879110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:11.879462 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:11.879821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] PATH_INFO: `/v3/projects/05c85b11fc3349088649d4d5adadbcfc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:11.881110 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c85b11fc3349088649d4d5adadbcfc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:11.883832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:12.058882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c85b11fc3349088649d4d5adadbcfc', 'request_id': 'req-31d35f9d-4d27-4095-abe6-c6182539ffca'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:12.088463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:12.089940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:12.147829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c33c0-525a-40be-9b52-a88218d8bf1c admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:12.153882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c85b11fc3349088649d4d5adadbcfc', 'request_id': 'req-31d35f9d-4d27-4095-abe6-c6182539ffca'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:12.162443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c85b11fc3349088649d4d5adadbcfc', 'request_id': 'req-31d35f9d-4d27-4095-abe6-c6182539ffca'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:12.179119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] The token cache is being invalidate because project 05c85b11fc3349088649d4d5adadbcfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:12.179370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:12.180035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-31d35f9d-4d27-4095-abe6-c6182539ffca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:12.181938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1308/2591] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:11 2022] DELETE /identity/v3/projects/05c85b11fc3349088649d4d5adadbcfc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:12.186833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ee2fd-313f-4271-acb8-34e9c24e1d28 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.186833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ee2fd-313f-4271-acb8-34e9c24e1d28 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.187080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ee2fd-313f-4271-acb8-34e9c24e1d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.201832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b268a93-7180-4fc2-be2d-03fa8e5ae685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:12.207444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b268a93-7180-4fc2-be2d-03fa8e5ae685 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.207444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b268a93-7180-4fc2-be2d-03fa8e5ae685 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.207444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b268a93-7180-4fc2-be2d-03fa8e5ae685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.207444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6b268a93-7180-4fc2-be2d-03fa8e5ae685 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:12.208893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6e9ee2fd-313f-4271-acb8-34e9c24e1d28 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:12.210624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6e9ee2fd-313f-4271-acb8-34e9c24e1d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:12.215107 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:12.272846 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1309/2592] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:12.273206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b268a93-7180-4fc2-be2d-03fa8e5ae685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:12.274708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b268a93-7180-4fc2-be2d-03fa8e5ae685 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:12.285485 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:12.285697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34174dd-7174-412f-8019-0764615e0be8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.285697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34174dd-7174-412f-8019-0764615e0be8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.285697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34174dd-7174-412f-8019-0764615e0be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.288843 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1284/2593] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:12.303688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e34174dd-7174-412f-8019-0764615e0be8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:12.304920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e34174dd-7174-412f-8019-0764615e0be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:12.312977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1310/2594] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:12.317500 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b268a93-7180-4fc2-be2d-03fa8e5ae685 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:12.328695 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b268a93-7180-4fc2-be2d-03fa8e5ae685 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:12.333712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e300a6-4102-4eab-a3d0-cf3496b512e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:12.334328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e300a6-4102-4eab-a3d0-cf3496b512e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.334628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e300a6-4102-4eab-a3d0-cf3496b512e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.335439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e300a6-4102-4eab-a3d0-cf3496b512e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.336124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e300a6-4102-4eab-a3d0-cf3496b512e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:12.336425 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e300a6-4102-4eab-a3d0-cf3496b512e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:12.338197 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e300a6-4102-4eab-a3d0-cf3496b512e0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:12.351263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1285/2595] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:12.355674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34174dd-7174-412f-8019-0764615e0be8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:12.365120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34174dd-7174-412f-8019-0764615e0be8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:12.370167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc2fd9-d885-433c-8582-7e12bf89c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:12.370783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc2fd9-d885-433c-8582-7e12bf89c1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.371065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc2fd9-d885-433c-8582-7e12bf89c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.371339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc2fd9-d885-433c-8582-7e12bf89c1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.372016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc2fd9-d885-433c-8582-7e12bf89c1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:12.373941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc2fd9-d885-433c-8582-7e12bf89c1f9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:12.515715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1311/2596] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:12 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:12.523951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e300a6-4102-4eab-a3d0-cf3496b512e0 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:12.534329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e300a6-4102-4eab-a3d0-cf3496b512e0 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:12.594429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494f227-e3b2-4ed3-946c-775aa26f3679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:12.595175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494f227-e3b2-4ed3-946c-775aa26f3679 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.595456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494f227-e3b2-4ed3-946c-775aa26f3679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.595728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494f227-e3b2-4ed3-946c-775aa26f3679 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.596393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494f227-e3b2-4ed3-946c-775aa26f3679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:12.598384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494f227-e3b2-4ed3-946c-775aa26f3679 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:12.720182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1286/2597] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:12 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:12.724440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc2fd9-d885-433c-8582-7e12bf89c1f9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:12.735067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc2fd9-d885-433c-8582-7e12bf89c1f9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:12.739868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a487c6e-8cad-487b-ae8a-7daefabc8542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:12.740506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a487c6e-8cad-487b-ae8a-7daefabc8542 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.740799 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a487c6e-8cad-487b-ae8a-7daefabc8542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.741644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a487c6e-8cad-487b-ae8a-7daefabc8542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.742378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a487c6e-8cad-487b-ae8a-7daefabc8542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:12.744485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a487c6e-8cad-487b-ae8a-7daefabc8542 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:12.754707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1312/2598] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:12.761328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494f227-e3b2-4ed3-946c-775aa26f3679 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:12.771885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494f227-e3b2-4ed3-946c-775aa26f3679 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:12.778757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507bd54-7d60-4ea2-a86c-9e92412a2e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:12.779366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507bd54-7d60-4ea2-a86c-9e92412a2e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.779649 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507bd54-7d60-4ea2-a86c-9e92412a2e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.779925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507bd54-7d60-4ea2-a86c-9e92412a2e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.780618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507bd54-7d60-4ea2-a86c-9e92412a2e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:12.782272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507bd54-7d60-4ea2-a86c-9e92412a2e00 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:12.793718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1287/2599] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:12.797991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a487c6e-8cad-487b-ae8a-7daefabc8542 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:12.807948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a487c6e-8cad-487b-ae8a-7daefabc8542 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:12.812471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac58d7-bd69-4f73-9783-48e74b39c68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:12.813162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac58d7-bd69-4f73-9783-48e74b39c68f admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.813447 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac58d7-bd69-4f73-9783-48e74b39c68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.813725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac58d7-bd69-4f73-9783-48e74b39c68f admin admin] PATH_INFO: `/v3/projects/007a2a812e5b4f1e901ec6761c9a00b5/users/981ff5ea531b46f980661ecbae69c93b/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.828307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac58d7-bd69-4f73-9783-48e74b39c68f admin admin] RBAC: Authorizing `identity:create_grant(project_id=007a2a812e5b4f1e901ec6761c9a00b5, user_id=981ff5ea531b46f980661ecbae69c93b, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:12.830983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac58d7-bd69-4f73-9783-48e74b39c68f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:12.942785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1313/2600] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:12 2022] PUT /identity/v3/projects/007a2a812e5b4f1e901ec6761c9a00b5/users/981ff5ea531b46f980661ecbae69c93b/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:12.954337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e133-3957-49d9-bebf-4f1c2801c40c None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:12.954626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e133-3957-49d9-bebf-4f1c2801c40c None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:12.954905 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e133-3957-49d9-bebf-4f1c2801c40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:12.987315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b759e133-3957-49d9-bebf-4f1c2801c40c None None] MFA Rules not processed for user `981ff5ea531b46f980661ecbae69c93b`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:12.988428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b759e133-3957-49d9-bebf-4f1c2801c40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:13.068942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1288/2601] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:13.078351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac58d7-bd69-4f73-9783-48e74b39c68f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:13.080185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-01ac58d7-bd69-4f73-9783-48e74b39c68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:13.146918 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac58d7-bd69-4f73-9783-48e74b39c68f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:13.150686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f763807-6b9f-4dc7-8d28-b8d867acc38a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18138af1ea504faca84b0cc2034ddd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:13.151304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f763807-6b9f-4dc7-8d28-b8d867acc38a service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:13.151587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f763807-6b9f-4dc7-8d28-b8d867acc38a service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:13.151864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f763807-6b9f-4dc7-8d28-b8d867acc38a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:13.160479 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f763807-6b9f-4dc7-8d28-b8d867acc38a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:13.162418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f763807-6b9f-4dc7-8d28-b8d867acc38a service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:13.174396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1314/2602] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:16.462580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759e133-3957-49d9-bebf-4f1c2801c40c None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:16.464010 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b759e133-3957-49d9-bebf-4f1c2801c40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:16.524331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759e133-3957-49d9-bebf-4f1c2801c40c None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:16.527976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75daf9-3c06-4558-abd6-21cc0811dcc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:16.528721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75daf9-3c06-4558-abd6-21cc0811dcc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:16.529364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75daf9-3c06-4558-abd6-21cc0811dcc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:16.529756 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75daf9-3c06-4558-abd6-21cc0811dcc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:16.532053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ad75daf9-3c06-4558-abd6-21cc0811dcc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:16.537423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:16.604609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75daf9-3c06-4558-abd6-21cc0811dcc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:16.606085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75daf9-3c06-4558-abd6-21cc0811dcc7 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:16.615727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1289/2603] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:20.658604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f763807-6b9f-4dc7-8d28-b8d867acc38a service glance] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:20.660041 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7f763807-6b9f-4dc7-8d28-b8d867acc38a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:20.675267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f763807-6b9f-4dc7-8d28-b8d867acc38a service glance] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:20.685926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:20.685926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:20.685926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:20.685926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] PATH_INFO: `/v3/users/e01fd82a1ff44587b45f72f82e1562a4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:20.686331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01fd82a1ff44587b45f72f82e1562a4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:20.686331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:20.937457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:20.944844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01fd82a1ff44587b45f72f82e1562a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:20.945519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01fd82a1ff44587b45f72f82e1562a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:20.954369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01fd82a1ff44587b45f72f82e1562a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:20.955138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01fd82a1ff44587b45f72f82e1562a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:20.970224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1bf9cb49-3482-4cce-8c05-55090c427644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01fd82a1ff44587b45f72f82e1562a4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.102665 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1315/2604] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:20 2022] DELETE /identity/v3/users/e01fd82a1ff44587b45f72f82e1562a4 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:21.360570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75daf9-3c06-4558-abd6-21cc0811dcc7 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:21.372173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75daf9-3c06-4558-abd6-21cc0811dcc7 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:21.435935 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:21.436718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:21.437087 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:21.437369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] PATH_INFO: `/v3/projects/fc34827d713e4d7ba12a1b93cf0878ca` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:21.438670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc34827d713e4d7ba12a1b93cf0878ca)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:21.440493 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:21.553457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc34827d713e4d7ba12a1b93cf0878ca', 'request_id': 'req-05593f96-0815-4c3f-aaa7-68a2afb97d11'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.559138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc34827d713e4d7ba12a1b93cf0878ca', 'request_id': 'req-05593f96-0815-4c3f-aaa7-68a2afb97d11'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.656501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc34827d713e4d7ba12a1b93cf0878ca', 'request_id': 'req-05593f96-0815-4c3f-aaa7-68a2afb97d11'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.669704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] The token cache is being invalidate because project fc34827d713e4d7ba12a1b93cf0878ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:21.670015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.670653 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-05593f96-0815-4c3f-aaa7-68a2afb97d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:21.672195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1290/2605] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:21 2022] DELETE /identity/v3/projects/fc34827d713e4d7ba12a1b93cf0878ca => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:21.677391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63ceda-60aa-4d6c-85b7-da50e587c817 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:21.677889 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63ceda-60aa-4d6c-85b7-da50e587c817 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:21.677990 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63ceda-60aa-4d6c-85b7-da50e587c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:21.698060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9e63ceda-60aa-4d6c-85b7-da50e587c817 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:21.699271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9e63ceda-60aa-4d6c-85b7-da50e587c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:21.761966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1316/2606] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:21.769677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a7484-612e-43d1-9db7-705b548f42e0 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:21.769960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a7484-612e-43d1-9db7-705b548f42e0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:21.770235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a7484-612e-43d1-9db7-705b548f42e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:21.791676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2a3a7484-612e-43d1-9db7-705b548f42e0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:21.792966 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2a3a7484-612e-43d1-9db7-705b548f42e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:21.801166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1291/2607] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:21.805541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63ceda-60aa-4d6c-85b7-da50e587c817 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:21.815125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63ceda-60aa-4d6c-85b7-da50e587c817 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:21.819645 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149780c-9097-43cb-85c4-7ee8470fa5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:21.821371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149780c-9097-43cb-85c4-7ee8470fa5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:21.821371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149780c-9097-43cb-85c4-7ee8470fa5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:21.821371 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149780c-9097-43cb-85c4-7ee8470fa5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:21.821768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149780c-9097-43cb-85c4-7ee8470fa5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:21.821768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149780c-9097-43cb-85c4-7ee8470fa5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:21.823344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149780c-9097-43cb-85c4-7ee8470fa5b8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:21.836569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1317/2608] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:21.843761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a7484-612e-43d1-9db7-705b548f42e0 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:21.853873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a7484-612e-43d1-9db7-705b548f42e0 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:21.859269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0004f-456c-4bce-afca-b62134f1bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:21.859882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0004f-456c-4bce-afca-b62134f1bee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:21.860163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0004f-456c-4bce-afca-b62134f1bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:21.860435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0004f-456c-4bce-afca-b62134f1bee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:21.861167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0004f-456c-4bce-afca-b62134f1bee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:21.863102 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0004f-456c-4bce-afca-b62134f1bee7 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.061559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:22.076982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1292/2609] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:21 2022] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:22.081212 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149780c-9097-43cb-85c4-7ee8470fa5b8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.273597 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149780c-9097-43cb-85c4-7ee8470fa5b8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.337532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7893a-776c-4d63-863c-185ff23970c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.360348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7893a-776c-4d63-863c-185ff23970c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.360348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7893a-776c-4d63-863c-185ff23970c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.360348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7893a-776c-4d63-863c-185ff23970c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.360348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7893a-776c-4d63-863c-185ff23970c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.360348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7893a-776c-4d63-863c-185ff23970c8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.362387 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:22.547934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1318/2610] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:22 2022] POST /identity/v3/users => generated 287 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:22.552098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0004f-456c-4bce-afca-b62134f1bee7 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.596982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0004f-456c-4bce-afca-b62134f1bee7 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.607050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b3ef3-c8b1-481d-ac35-be71aa68f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.609080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b3ef3-c8b1-481d-ac35-be71aa68f5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.609080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b3ef3-c8b1-481d-ac35-be71aa68f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.609080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b3ef3-c8b1-481d-ac35-be71aa68f5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.609080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b3ef3-c8b1-481d-ac35-be71aa68f5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.611565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b3ef3-c8b1-481d-ac35-be71aa68f5f7 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.626221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1293/2611] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:22.627449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7893a-776c-4d63-863c-185ff23970c8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.643663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7893a-776c-4d63-863c-185ff23970c8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.643663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964687a-ab73-4fe5-8abc-c878d79cc00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.643663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964687a-ab73-4fe5-8abc-c878d79cc00e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.643663 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964687a-ab73-4fe5-8abc-c878d79cc00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.644054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964687a-ab73-4fe5-8abc-c878d79cc00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.644309 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964687a-ab73-4fe5-8abc-c878d79cc00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.645935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964687a-ab73-4fe5-8abc-c878d79cc00e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.656483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1319/2612] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:22.660896 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b3ef3-c8b1-481d-ac35-be71aa68f5f7 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.680420 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b3ef3-c8b1-481d-ac35-be71aa68f5f7 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:22.685091 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139863-e717-4a3f-a826-e93ef4dfd88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:22.685751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139863-e717-4a3f-a826-e93ef4dfd88a admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.686029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139863-e717-4a3f-a826-e93ef4dfd88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.686300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139863-e717-4a3f-a826-e93ef4dfd88a admin admin] PATH_INFO: `/v3/projects/dadbf186d97b4dbeb880e054657d6d2c/users/aadfdaf74cbb452a889a6bdf87922feb/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.705920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139863-e717-4a3f-a826-e93ef4dfd88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dadbf186d97b4dbeb880e054657d6d2c, user_id=aadfdaf74cbb452a889a6bdf87922feb, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:22.705920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139863-e717-4a3f-a826-e93ef4dfd88a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:22.788489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1294/2613] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:22 2022] PUT /identity/v3/projects/dadbf186d97b4dbeb880e054657d6d2c/users/aadfdaf74cbb452a889a6bdf87922feb/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:22.801843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a7aca-6710-4334-819b-dd31e3265678 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:22.802354 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a7aca-6710-4334-819b-dd31e3265678 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:22.802473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a7aca-6710-4334-819b-dd31e3265678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:22.830327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-184a7aca-6710-4334-819b-dd31e3265678 None None] MFA Rules not processed for user `aadfdaf74cbb452a889a6bdf87922feb`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:22.831514 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-184a7aca-6710-4334-819b-dd31e3265678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:22.898545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1320/2614] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:22.909725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139863-e717-4a3f-a826-e93ef4dfd88a admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:22.911471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e3139863-e717-4a3f-a826-e93ef4dfd88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.037503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139863-e717-4a3f-a826-e93ef4dfd88a admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.044612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0b855-9094-428a-a281-e427d95cc9f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb85b3e1dc464438ac007c1b09ea7fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.045264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0b855-9094-428a-a281-e427d95cc9f6 service nova] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.045551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0b855-9094-428a-a281-e427d95cc9f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.045825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0b855-9094-428a-a281-e427d95cc9f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.054341 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0b855-9094-428a-a281-e427d95cc9f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.055874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0b855-9094-428a-a281-e427d95cc9f6 service nova] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.064611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1295/2615] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:23.142473 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a7aca-6710-4334-819b-dd31e3265678 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.143863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-184a7aca-6710-4334-819b-dd31e3265678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.218581 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a7aca-6710-4334-819b-dd31e3265678 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.223040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.223682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.224005 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.224221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] PATH_INFO: `/v3/users/3f973a3a9b4041c4a359cebd1798b851` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.226642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f973a3a9b4041c4a359cebd1798b851)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.228587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.301084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0b855-9094-428a-a281-e427d95cc9f6 service nova] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.312093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0b855-9094-428a-a281-e427d95cc9f6 service nova] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.317007 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.317658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.317941 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.318222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] PATH_INFO: `/v3/users/aadfdaf74cbb452a889a6bdf87922feb` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.319482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadfdaf74cbb452a889a6bdf87922feb)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.321485 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.345892 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:23.402104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f973a3a9b4041c4a359cebd1798b851'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.402806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f973a3a9b4041c4a359cebd1798b851'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.410216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f973a3a9b4041c4a359cebd1798b851'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.413881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f973a3a9b4041c4a359cebd1798b851'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.427237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:23.429670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fcebdb4b-d1d7-44a3-b040-f5ddab0b548a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f973a3a9b4041c4a359cebd1798b851'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.519090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1321/2616] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:23 2022] DELETE /identity/v3/users/3f973a3a9b4041c4a359cebd1798b851 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:23.523548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950114c-131c-4832-8ce7-b36df8a8195c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.525011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950114c-131c-4832-8ce7-b36df8a8195c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.525011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950114c-131c-4832-8ce7-b36df8a8195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.527591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadfdaf74cbb452a889a6bdf87922feb'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.528261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadfdaf74cbb452a889a6bdf87922feb'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.552855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c950114c-131c-4832-8ce7-b36df8a8195c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:23.559688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c950114c-131c-4832-8ce7-b36df8a8195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.599327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadfdaf74cbb452a889a6bdf87922feb'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.599960 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadfdaf74cbb452a889a6bdf87922feb'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.612917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-3a503d74-6c5e-49ff-9c61-e91fb413157e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadfdaf74cbb452a889a6bdf87922feb'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:23.617606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1322/2617] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:23.627497 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950114c-131c-4832-8ce7-b36df8a8195c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.628926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c950114c-131c-4832-8ce7-b36df8a8195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.629308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1296/2618] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:23 2022] DELETE /identity/v3/users/aadfdaf74cbb452a889a6bdf87922feb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:23.634512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ee07-adef-4020-b802-6dedeb8fd30d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.634793 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ee07-adef-4020-b802-6dedeb8fd30d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.635068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ee07-adef-4020-b802-6dedeb8fd30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.659953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-7c35ee07-adef-4020-b802-6dedeb8fd30d None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:23.661375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7c35ee07-adef-4020-b802-6dedeb8fd30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.688584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950114c-131c-4832-8ce7-b36df8a8195c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.747536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1297/2619] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:23.753688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3667f15-2265-4837-b2cb-1f7765c48704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.754325 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3667f15-2265-4837-b2cb-1f7765c48704 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.754610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3667f15-2265-4837-b2cb-1f7765c48704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.754946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3667f15-2265-4837-b2cb-1f7765c48704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.759994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35ee07-adef-4020-b802-6dedeb8fd30d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:23.761611 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7c35ee07-adef-4020-b802-6dedeb8fd30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:23.765607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3667f15-2265-4837-b2cb-1f7765c48704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.767245 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3667f15-2265-4837-b2cb-1f7765c48704 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.775147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35ee07-adef-4020-b802-6dedeb8fd30d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:23.778943 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f709e-8b90-4eeb-80d8-61a35edcfa47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:23.779555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f709e-8b90-4eeb-80d8-61a35edcfa47 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:23.779872 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1323/2620] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:23.780004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f709e-8b90-4eeb-80d8-61a35edcfa47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:23.780179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f709e-8b90-4eeb-80d8-61a35edcfa47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:23.790338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f709e-8b90-4eeb-80d8-61a35edcfa47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:23.791802 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f709e-8b90-4eeb-80d8-61a35edcfa47 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:23.801601 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1298/2621] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:24.318661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3667f15-2265-4837-b2cb-1f7765c48704 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:24.319180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f709e-8b90-4eeb-80d8-61a35edcfa47 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:24.319359 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a3667f15-2265-4837-b2cb-1f7765c48704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:24.319458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f59f709e-8b90-4eeb-80d8-61a35edcfa47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:24.331067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3667f15-2265-4837-b2cb-1f7765c48704 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:24.336737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:24.337276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.337551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.337817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] PATH_INFO: `/v3/projects/73b328506d114aa1ae7506da398c1be3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.338978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b328506d114aa1ae7506da398c1be3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:24.341148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:24.344116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f709e-8b90-4eeb-80d8-61a35edcfa47 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:24.353404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:24.354208 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.354647 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.355164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] PATH_INFO: `/v3/projects/dadbf186d97b4dbeb880e054657d6d2c` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.356447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dadbf186d97b4dbeb880e054657d6d2c)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:24.358770 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:24.494141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:24.503216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dadbf186d97b4dbeb880e054657d6d2c', 'request_id': 'req-29fa5b02-bcec-425d-865c-099b71548718'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.503615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b328506d114aa1ae7506da398c1be3', 'request_id': 'req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.509210 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dadbf186d97b4dbeb880e054657d6d2c', 'request_id': 'req-29fa5b02-bcec-425d-865c-099b71548718'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.651269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b328506d114aa1ae7506da398c1be3', 'request_id': 'req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.657564 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b328506d114aa1ae7506da398c1be3', 'request_id': 'req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.669008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] The token cache is being invalidate because project 73b328506d114aa1ae7506da398c1be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:24.669293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.669954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.671443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1324/2622] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:24 2022] DELETE /identity/v3/projects/73b328506d114aa1ae7506da398c1be3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:24.675247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:24.676540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:24.738965 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbcdf5-7f02-48dd-b9a0-358ac426e9a2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:24.744190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:24.744856 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.745138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.745411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] PATH_INFO: `/v3/users/cf7364b66a0549d48f77c1dd4c63d317` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.746591 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7364b66a0549d48f77c1dd4c63d317)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:24.748523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:24.810604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dadbf186d97b4dbeb880e054657d6d2c', 'request_id': 'req-29fa5b02-bcec-425d-865c-099b71548718'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.822238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] The token cache is being invalidate because project dadbf186d97b4dbeb880e054657d6d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:24.822521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.823132 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-29fa5b02-bcec-425d-865c-099b71548718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:24.824618 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1299/2623] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:24 2022] DELETE /identity/v3/projects/dadbf186d97b4dbeb880e054657d6d2c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:24.829365 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f4301-8436-48d1-b775-e7e6127075a6 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.829707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f4301-8436-48d1-b775-e7e6127075a6 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.829919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f4301-8436-48d1-b775-e7e6127075a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.842565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:24.878559 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-576f4301-8436-48d1-b775-e7e6127075a6 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:24.879671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-576f4301-8436-48d1-b775-e7e6127075a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:24.887436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1300/2624] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:24.895308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa4210-5a70-4118-80bc-b44696940ac1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.899805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa4210-5a70-4118-80bc-b44696940ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.899805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa4210-5a70-4118-80bc-b44696940ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.916055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c5aa4210-5a70-4118-80bc-b44696940ac1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:24.917294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c5aa4210-5a70-4118-80bc-b44696940ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:24.925216 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1301/2625] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:24.929359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa4210-5a70-4118-80bc-b44696940ac1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:24.938238 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa4210-5a70-4118-80bc-b44696940ac1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:24.942945 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f6721-e837-4c7f-976d-59e389c496a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:24.945568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f6721-e837-4c7f-976d-59e389c496a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.945568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f6721-e837-4c7f-976d-59e389c496a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.945568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f6721-e837-4c7f-976d-59e389c496a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.945568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f6721-e837-4c7f-976d-59e389c496a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:24.945568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f6721-e837-4c7f-976d-59e389c496a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:24.946774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f6721-e837-4c7f-976d-59e389c496a5 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:24.958172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1302/2626] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:16:24.962572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f6721-e837-4c7f-976d-59e389c496a5 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:24.972364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f6721-e837-4c7f-976d-59e389c496a5 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:24.977362 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41a17e-2c9c-4f09-b191-0377f35555de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:24.977920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41a17e-2c9c-4f09-b191-0377f35555de admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:24.978194 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41a17e-2c9c-4f09-b191-0377f35555de admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:24.978461 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41a17e-2c9c-4f09-b191-0377f35555de admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:24.979090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41a17e-2c9c-4f09-b191-0377f35555de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:24.980940 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41a17e-2c9c-4f09-b191-0377f35555de admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:25.012669 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7364b66a0549d48f77c1dd4c63d317'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:25.013363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7364b66a0549d48f77c1dd4c63d317'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:25.020931 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7364b66a0549d48f77c1dd4c63d317'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:25.021607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7364b66a0549d48f77c1dd4c63d317'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:25.036934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7364b66a0549d48f77c1dd4c63d317'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:25.115230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1303/2627] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:24 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:25.119820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41a17e-2c9c-4f09-b191-0377f35555de admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:25.122174 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9b41a17e-2c9c-4f09-b191-0377f35555de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:25.155824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1325/2628] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:24 2022] DELETE /identity/v3/users/cf7364b66a0549d48f77c1dd4c63d317 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:25.192645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41a17e-2c9c-4f09-b191-0377f35555de admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:25.271780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a2213-f04d-4ecb-94b1-92dfc2056aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:25.271780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a2213-f04d-4ecb-94b1-92dfc2056aee admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:25.271780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a2213-f04d-4ecb-94b1-92dfc2056aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:25.271780 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a2213-f04d-4ecb-94b1-92dfc2056aee admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:25.272351 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a2213-f04d-4ecb-94b1-92dfc2056aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:25.273480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a2213-f04d-4ecb-94b1-92dfc2056aee admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:25.372775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1304/2629] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:25 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:25.377612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:25.388461 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a361-c623-4ba7-8cf7-12a06cefb02e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:25.393803 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205d3d3-6d29-4b89-a71d-2c781657b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:25.394417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205d3d3-6d29-4b89-a71d-2c781657b4cc admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:25.394694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205d3d3-6d29-4b89-a71d-2c781657b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:25.394965 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205d3d3-6d29-4b89-a71d-2c781657b4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:25.395655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205d3d3-6d29-4b89-a71d-2c781657b4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:25.397324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205d3d3-6d29-4b89-a71d-2c781657b4cc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:25.411540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1326/2630] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:25.418181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a2213-f04d-4ecb-94b1-92dfc2056aee admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:25.429796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a2213-f04d-4ecb-94b1-92dfc2056aee admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:25.434552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0bd30-2f11-4253-93b8-5619993f7a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:25.435164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0bd30-2f11-4253-93b8-5619993f7a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:25.435444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0bd30-2f11-4253-93b8-5619993f7a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:25.435715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0bd30-2f11-4253-93b8-5619993f7a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:25.436409 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0bd30-2f11-4253-93b8-5619993f7a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:25.438084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0bd30-2f11-4253-93b8-5619993f7a7e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:25.448392 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1305/2631] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:25.452745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205d3d3-6d29-4b89-a71d-2c781657b4cc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:25.463231 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205d3d3-6d29-4b89-a71d-2c781657b4cc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:25.472002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2590a-c4f6-44a1-9fd9-e81b357aaa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:25.472002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2590a-c4f6-44a1-9fd9-e81b357aaa94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:25.472002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2590a-c4f6-44a1-9fd9-e81b357aaa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:25.472002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2590a-c4f6-44a1-9fd9-e81b357aaa94 admin admin] PATH_INFO: `/v3/projects/f89ae435b6bd4f7594efe7d25f049365/users/8212c625710d439aa1f961a79a2e8078/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:25.492844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2590a-c4f6-44a1-9fd9-e81b357aaa94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89ae435b6bd4f7594efe7d25f049365, user_id=8212c625710d439aa1f961a79a2e8078, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:25.495657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2590a-c4f6-44a1-9fd9-e81b357aaa94 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:25.589229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1327/2632] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:25 2022] PUT /identity/v3/projects/f89ae435b6bd4f7594efe7d25f049365/users/8212c625710d439aa1f961a79a2e8078/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:25.599807 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae235e6-0aba-45a3-bfa3-2c8c22b03bc7 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:25.600130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae235e6-0aba-45a3-bfa3-2c8c22b03bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:25.600438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae235e6-0aba-45a3-bfa3-2c8c22b03bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:25.628696 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-cae235e6-0aba-45a3-bfa3-2c8c22b03bc7 None None] MFA Rules not processed for user `8212c625710d439aa1f961a79a2e8078`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:25.629962 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cae235e6-0aba-45a3-bfa3-2c8c22b03bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:25.640001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:25.649008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2590a-c4f6-44a1-9fd9-e81b357aaa94 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:25.653180 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-27b2590a-c4f6-44a1-9fd9-e81b357aaa94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:25.686553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:25.735997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1306/2633] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:25.740468 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae235e6-0aba-45a3-bfa3-2c8c22b03bc7 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:25.767875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2590a-c4f6-44a1-9fd9-e81b357aaa94 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:25.772837 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:25.773470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:25.773778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:25.774194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] PATH_INFO: `/v3/projects/5ee52b56bb444f6c8f4f5cd369e81689` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:25.775646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee52b56bb444f6c8f4f5cd369e81689)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:25.777606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:25.813647 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae235e6-0aba-45a3-bfa3-2c8c22b03bc7 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:25.820831 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985dc2-d891-4b14-a100-da157e464934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:25.821462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985dc2-d891-4b14-a100-da157e464934 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:25.821747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985dc2-d891-4b14-a100-da157e464934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:25.822013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985dc2-d891-4b14-a100-da157e464934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:25.822676 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985dc2-d891-4b14-a100-da157e464934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:25.824596 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985dc2-d891-4b14-a100-da157e464934 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:25.942880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee52b56bb444f6c8f4f5cd369e81689', 'request_id': 'req-ad46c0f0-290d-47c6-8839-1229b3d88be2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:25.981675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1307/2634] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:25 2022] POST /identity/v3/projects => generated 371 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:25.982734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985dc2-d891-4b14-a100-da157e464934 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.048200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985dc2-d891-4b14-a100-da157e464934 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.050980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee52b56bb444f6c8f4f5cd369e81689', 'request_id': 'req-ad46c0f0-290d-47c6-8839-1229b3d88be2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:26.058136 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b52c5-889f-4522-95aa-7f810125fcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.058498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee52b56bb444f6c8f4f5cd369e81689', 'request_id': 'req-ad46c0f0-290d-47c6-8839-1229b3d88be2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:26.058757 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b52c5-889f-4522-95aa-7f810125fcae admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.059036 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b52c5-889f-4522-95aa-7f810125fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.059312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b52c5-889f-4522-95aa-7f810125fcae admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.059971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b52c5-889f-4522-95aa-7f810125fcae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.061934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b52c5-889f-4522-95aa-7f810125fcae admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.070619 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] The token cache is being invalidate because project 5ee52b56bb444f6c8f4f5cd369e81689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:26.070981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:26.071754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ad46c0f0-290d-47c6-8839-1229b3d88be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:26.073373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1328/2635] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:25 2022] DELETE /identity/v3/projects/5ee52b56bb444f6c8f4f5cd369e81689 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:26.080292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169f84-4aca-4e46-b49b-d25609b4ebd7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.080688 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169f84-4aca-4e46-b49b-d25609b4ebd7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.081051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169f84-4aca-4e46-b49b-d25609b4ebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.101575 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2f169f84-4aca-4e46-b49b-d25609b4ebd7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:26.102798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2f169f84-4aca-4e46-b49b-d25609b4ebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:26.110953 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1329/2636] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:26.119460 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a57ec7-d28f-46f9-b46d-7903b87c8cc8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.119745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a57ec7-d28f-46f9-b46d-7903b87c8cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.120017 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a57ec7-d28f-46f9-b46d-7903b87c8cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.139014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-29a57ec7-d28f-46f9-b46d-7903b87c8cc8 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:26.140513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-29a57ec7-d28f-46f9-b46d-7903b87c8cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:26.149018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1330/2637] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:26.153121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a57ec7-d28f-46f9-b46d-7903b87c8cc8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.162142 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a57ec7-d28f-46f9-b46d-7903b87c8cc8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.168457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a6890-8929-49df-a265-188703cfe8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.168457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a6890-8929-49df-a265-188703cfe8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.168740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a6890-8929-49df-a265-188703cfe8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.169309 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a6890-8929-49df-a265-188703cfe8d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.169714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a6890-8929-49df-a265-188703cfe8d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:26.170018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a6890-8929-49df-a265-188703cfe8d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.171606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a6890-8929-49df-a265-188703cfe8d6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.185701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1331/2638] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:16:26.189984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a6890-8929-49df-a265-188703cfe8d6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.202841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1308/2639] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:25 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:26.202841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b52c5-889f-4522-95aa-7f810125fcae admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.203079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a6890-8929-49df-a265-188703cfe8d6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.203417 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4d9b52c5-889f-4522-95aa-7f810125fcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:26.208393 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998fb4a-5b80-42e8-850b-df66a7f1b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.209091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998fb4a-5b80-42e8-850b-df66a7f1b243 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.209373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998fb4a-5b80-42e8-850b-df66a7f1b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.209648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998fb4a-5b80-42e8-850b-df66a7f1b243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.210321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998fb4a-5b80-42e8-850b-df66a7f1b243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.215227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998fb4a-5b80-42e8-850b-df66a7f1b243 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.230124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b52c5-889f-4522-95aa-7f810125fcae admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.236691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8180102-2e22-4c95-8e5a-662b346b7bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.242684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8180102-2e22-4c95-8e5a-662b346b7bda admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.242684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8180102-2e22-4c95-8e5a-662b346b7bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.242684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8180102-2e22-4c95-8e5a-662b346b7bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.242684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8180102-2e22-4c95-8e5a-662b346b7bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.242684 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8180102-2e22-4c95-8e5a-662b346b7bda admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.255456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1309/2640] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:26.259751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8180102-2e22-4c95-8e5a-662b346b7bda admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.269813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8180102-2e22-4c95-8e5a-662b346b7bda admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.275192 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558e44-a19f-4d9c-a9b8-838909fe157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.275888 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558e44-a19f-4d9c-a9b8-838909fe157a admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.276170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558e44-a19f-4d9c-a9b8-838909fe157a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.276447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558e44-a19f-4d9c-a9b8-838909fe157a admin admin] PATH_INFO: `/v3/projects/3414c4214d7f41389ac54bf24e1de7cf/users/f48ada3423dc4100bb8bd29826e76aab/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.289548 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:26.292700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59558e44-a19f-4d9c-a9b8-838909fe157a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3414c4214d7f41389ac54bf24e1de7cf, user_id=f48ada3423dc4100bb8bd29826e76aab, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.295462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59558e44-a19f-4d9c-a9b8-838909fe157a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.356743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1332/2641] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:26 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:26.361522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998fb4a-5b80-42e8-850b-df66a7f1b243 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.422847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1310/2642] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:26 2022] PUT /identity/v3/projects/3414c4214d7f41389ac54bf24e1de7cf/users/f48ada3423dc4100bb8bd29826e76aab/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:26.427039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558e44-a19f-4d9c-a9b8-838909fe157a admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.429164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998fb4a-5b80-42e8-850b-df66a7f1b243 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.488562 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f44c-cf75-4f51-9f01-5ee947300a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.489164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f44c-cf75-4f51-9f01-5ee947300a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.489449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f44c-cf75-4f51-9f01-5ee947300a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.489727 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f44c-cf75-4f51-9f01-5ee947300a2a admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.490409 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f44c-cf75-4f51-9f01-5ee947300a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.492473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558e44-a19f-4d9c-a9b8-838909fe157a admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.492880 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f44c-cf75-4f51-9f01-5ee947300a2a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.498665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76632904-4e64-4b47-bdf4-af7fa9f3ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.499310 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76632904-4e64-4b47-bdf4-af7fa9f3ef2f admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.499585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76632904-4e64-4b47-bdf4-af7fa9f3ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.499875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76632904-4e64-4b47-bdf4-af7fa9f3ef2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.500771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76632904-4e64-4b47-bdf4-af7fa9f3ef2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.502237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76632904-4e64-4b47-bdf4-af7fa9f3ef2f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.513277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1311/2643] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:26.517408 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76632904-4e64-4b47-bdf4-af7fa9f3ef2f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.527243 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76632904-4e64-4b47-bdf4-af7fa9f3ef2f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.532771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17280904-43b1-4e73-b16c-20824a984832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.533449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17280904-43b1-4e73-b16c-20824a984832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.533806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17280904-43b1-4e73-b16c-20824a984832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.534079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17280904-43b1-4e73-b16c-20824a984832 admin admin] PATH_INFO: `/v3/projects/3414c4214d7f41389ac54bf24e1de7cf/users/f48ada3423dc4100bb8bd29826e76aab/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.536150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17280904-43b1-4e73-b16c-20824a984832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3414c4214d7f41389ac54bf24e1de7cf, user_id=f48ada3423dc4100bb8bd29826e76aab, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.538932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17280904-43b1-4e73-b16c-20824a984832 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.549045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1312/2644] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:26 2022] PUT /identity/v3/projects/3414c4214d7f41389ac54bf24e1de7cf/users/f48ada3423dc4100bb8bd29826e76aab/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:26.561382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb0130-8411-4a60-be01-a60f1bd08e91 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.561679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb0130-8411-4a60-be01-a60f1bd08e91 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.561953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb0130-8411-4a60-be01-a60f1bd08e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.567115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1333/2645] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:26 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:26.571605 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f44c-cf75-4f51-9f01-5ee947300a2a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.583328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f44c-cf75-4f51-9f01-5ee947300a2a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.591649 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-16bb0130-8411-4a60-be01-a60f1bd08e91 None None] MFA Rules not processed for user `f48ada3423dc4100bb8bd29826e76aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:26.593051 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-16bb0130-8411-4a60-be01-a60f1bd08e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:26.635061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:26.650138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026e9a9-7ffd-41c1-aa86-ead09bada85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.650755 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026e9a9-7ffd-41c1-aa86-ead09bada85f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.651030 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026e9a9-7ffd-41c1-aa86-ead09bada85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.651303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026e9a9-7ffd-41c1-aa86-ead09bada85f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.652000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026e9a9-7ffd-41c1-aa86-ead09bada85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.653636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026e9a9-7ffd-41c1-aa86-ead09bada85f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.664721 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1334/2646] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:26.668530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026e9a9-7ffd-41c1-aa86-ead09bada85f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.673523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1313/2647] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:26.680149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026e9a9-7ffd-41c1-aa86-ead09bada85f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.685210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee904ea-cb67-4d38-a33a-0a42c8220cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.685822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee904ea-cb67-4d38-a33a-0a42c8220cda admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.686096 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee904ea-cb67-4d38-a33a-0a42c8220cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.686396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee904ea-cb67-4d38-a33a-0a42c8220cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.688900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee904ea-cb67-4d38-a33a-0a42c8220cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.688900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee904ea-cb67-4d38-a33a-0a42c8220cda admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.689489 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb0130-8411-4a60-be01-a60f1bd08e91 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.692281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-16bb0130-8411-4a60-be01-a60f1bd08e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:26.699745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1335/2648] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:26.709338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee904ea-cb67-4d38-a33a-0a42c8220cda admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:26.721003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee904ea-cb67-4d38-a33a-0a42c8220cda admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.727595 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d535a8-c33c-4b86-aae6-a461e125d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.728372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d535a8-c33c-4b86-aae6-a461e125d33d admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.728705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d535a8-c33c-4b86-aae6-a461e125d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.729171 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d535a8-c33c-4b86-aae6-a461e125d33d admin admin] PATH_INFO: `/v3/projects/0ce59a73b74042d8a60a40f6fd565441/users/4cb8cf393a2843638595d6f37964a446/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.749638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d535a8-c33c-4b86-aae6-a461e125d33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce59a73b74042d8a60a40f6fd565441, user_id=4cb8cf393a2843638595d6f37964a446, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.752957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d535a8-c33c-4b86-aae6-a461e125d33d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.778936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb0130-8411-4a60-be01-a60f1bd08e91 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:26.782586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a4cce-205f-4e65-865d-60c4dbef71d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:26.783200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a4cce-205f-4e65-865d-60c4dbef71d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.783478 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a4cce-205f-4e65-865d-60c4dbef71d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.783753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a4cce-205f-4e65-865d-60c4dbef71d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.793878 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a4cce-205f-4e65-865d-60c4dbef71d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:26.794804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a4cce-205f-4e65-865d-60c4dbef71d1 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:26.805034 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1314/2649] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:26.857747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1336/2650] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:26 2022] PUT /identity/v3/projects/0ce59a73b74042d8a60a40f6fd565441/users/4cb8cf393a2843638595d6f37964a446/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:26.868704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81001b-9ce6-44e4-96ea-41cffe755de1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:26.869236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81001b-9ce6-44e4-96ea-41cffe755de1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:26.869337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81001b-9ce6-44e4-96ea-41cffe755de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:26.876387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:26.896722 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-bc81001b-9ce6-44e4-96ea-41cffe755de1 None None] MFA Rules not processed for user `4cb8cf393a2843638595d6f37964a446`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:26.898006 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bc81001b-9ce6-44e4-96ea-41cffe755de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:26.978544 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1315/2651] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:26.983366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d535a8-c33c-4b86-aae6-a461e125d33d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:27.048074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d535a8-c33c-4b86-aae6-a461e125d33d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:27.052715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2c745-df7e-4cdc-8170-7eecdd861993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:27.053529 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2c745-df7e-4cdc-8170-7eecdd861993 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:27.053810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2c745-df7e-4cdc-8170-7eecdd861993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:27.054083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2c745-df7e-4cdc-8170-7eecdd861993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:27.054853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2c745-df7e-4cdc-8170-7eecdd861993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:27.056731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2c745-df7e-4cdc-8170-7eecdd861993 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:27.212278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1337/2652] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:26 2022] POST /identity/v3/projects => generated 381 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:27.216100 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81001b-9ce6-44e4-96ea-41cffe755de1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:27.227825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81001b-9ce6-44e4-96ea-41cffe755de1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:27.298345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7458-5d78-413c-a5b1-6c7b0d96625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:27.299094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b7458-5d78-413c-a5b1-6c7b0d96625b admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:27.299712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b7458-5d78-413c-a5b1-6c7b0d96625b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:27.300058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b7458-5d78-413c-a5b1-6c7b0d96625b admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:27.301540 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b7458-5d78-413c-a5b1-6c7b0d96625b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:27.303732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b7458-5d78-413c-a5b1-6c7b0d96625b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:27.400603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1316/2653] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:27 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:27.404635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2c745-df7e-4cdc-8170-7eecdd861993 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:27.415138 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2c745-df7e-4cdc-8170-7eecdd861993 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:27.419656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddaf17-c528-4c87-a1ad-6f947d8dbe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:27.420252 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddaf17-c528-4c87-a1ad-6f947d8dbe5d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:27.420524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddaf17-c528-4c87-a1ad-6f947d8dbe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:27.420806 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddaf17-c528-4c87-a1ad-6f947d8dbe5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:27.421493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddaf17-c528-4c87-a1ad-6f947d8dbe5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:27.423044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddaf17-c528-4c87-a1ad-6f947d8dbe5d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:27.433338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1338/2654] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:27.437313 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7458-5d78-413c-a5b1-6c7b0d96625b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:27.448201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7458-5d78-413c-a5b1-6c7b0d96625b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:27.452846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea049d89-f4e5-4ea3-9871-e45401264049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:27.453492 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea049d89-f4e5-4ea3-9871-e45401264049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:27.453769 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea049d89-f4e5-4ea3-9871-e45401264049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:27.454039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea049d89-f4e5-4ea3-9871-e45401264049 admin admin] PATH_INFO: `/v3/projects/2321f117b7814186b4809cc74a2c5483/users/2635492752214a33be903b352edb3318/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:27.469405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea049d89-f4e5-4ea3-9871-e45401264049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2321f117b7814186b4809cc74a2c5483, user_id=2635492752214a33be903b352edb3318, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:27.472124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea049d89-f4e5-4ea3-9871-e45401264049 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:27.519413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:27.628326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1317/2655] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:27 2022] PUT /identity/v3/projects/2321f117b7814186b4809cc74a2c5483/users/2635492752214a33be903b352edb3318/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:27.633023 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddaf17-c528-4c87-a1ad-6f947d8dbe5d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:27.643148 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddaf17-c528-4c87-a1ad-6f947d8dbe5d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:27.706012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f2344-df34-4579-8537-2cc94cda17e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:27.706629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f2344-df34-4579-8537-2cc94cda17e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:27.706921 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f2344-df34-4579-8537-2cc94cda17e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:27.707170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f2344-df34-4579-8537-2cc94cda17e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:27.707857 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f2344-df34-4579-8537-2cc94cda17e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:27.709505 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f2344-df34-4579-8537-2cc94cda17e3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:27.719539 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1339/2656] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:27.723744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea049d89-f4e5-4ea3-9871-e45401264049 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:27.739161 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea049d89-f4e5-4ea3-9871-e45401264049 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:27.744421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d467477-7ebc-4463-a421-dbcb14b6f58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:27.745112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d467477-7ebc-4463-a421-dbcb14b6f58b admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:27.745396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d467477-7ebc-4463-a421-dbcb14b6f58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:27.745669 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d467477-7ebc-4463-a421-dbcb14b6f58b admin admin] PATH_INFO: `/v3/projects/2321f117b7814186b4809cc74a2c5483/users/2635492752214a33be903b352edb3318/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:27.747891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d467477-7ebc-4463-a421-dbcb14b6f58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2321f117b7814186b4809cc74a2c5483, user_id=2635492752214a33be903b352edb3318, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:27.754524 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d467477-7ebc-4463-a421-dbcb14b6f58b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:27.766958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1318/2657] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:27 2022] PUT /identity/v3/projects/2321f117b7814186b4809cc74a2c5483/users/2635492752214a33be903b352edb3318/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:27.778831 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748032e-e5dc-44a6-a993-d694b1ac40c2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:27.779296 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748032e-e5dc-44a6-a993-d694b1ac40c2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:27.779629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748032e-e5dc-44a6-a993-d694b1ac40c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:27.810244 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d748032e-e5dc-44a6-a993-d694b1ac40c2 None None] MFA Rules not processed for user `2635492752214a33be903b352edb3318`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:27.811495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d748032e-e5dc-44a6-a993-d694b1ac40c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:27.909917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1340/2658] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:27.919690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d467477-7ebc-4463-a421-dbcb14b6f58b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:27.972848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:27.984386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d467477-7ebc-4463-a421-dbcb14b6f58b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:27.988437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d744c3-b964-4cf4-b8e9-284e1dc77d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:27.989192 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d744c3-b964-4cf4-b8e9-284e1dc77d3d service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:27.989393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d744c3-b964-4cf4-b8e9-284e1dc77d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:27.989697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d744c3-b964-4cf4-b8e9-284e1dc77d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:28.000221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d744c3-b964-4cf4-b8e9-284e1dc77d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:28.001703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d744c3-b964-4cf4-b8e9-284e1dc77d3d service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:28.012032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1319/2659] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:28.143523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748032e-e5dc-44a6-a993-d694b1ac40c2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:28.206095 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748032e-e5dc-44a6-a993-d694b1ac40c2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:28.214443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:28.215129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:28.215406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:28.215686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] PATH_INFO: `/v3/users/8212c625710d439aa1f961a79a2e8078` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:28.216934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8212c625710d439aa1f961a79a2e8078)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:28.219352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:28.466593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8212c625710d439aa1f961a79a2e8078'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:28.467257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8212c625710d439aa1f961a79a2e8078'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:28.474388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8212c625710d439aa1f961a79a2e8078'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:28.475014 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8212c625710d439aa1f961a79a2e8078'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:28.488056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8212c625710d439aa1f961a79a2e8078'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:28.559139 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1341/2660] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:28 2022] DELETE /identity/v3/users/8212c625710d439aa1f961a79a2e8078 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:28.563699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e635d-5e32-4946-a09d-da15395ac5b5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:28.563997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e635d-5e32-4946-a09d-da15395ac5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:28.564253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e635d-5e32-4946-a09d-da15395ac5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:28.586261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c10e635d-5e32-4946-a09d-da15395ac5b5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:28.587769 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c10e635d-5e32-4946-a09d-da15395ac5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:28.622652 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:28.778080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1320/2661] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:28.789671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:28.791086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:28.852687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576680-e1c6-42f2-881b-7878979e08a2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:28.856378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172058a9-9686-4b29-b1bd-1175f6e14329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:28.857020 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172058a9-9686-4b29-b1bd-1175f6e14329 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:28.857301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172058a9-9686-4b29-b1bd-1175f6e14329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:28.857572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172058a9-9686-4b29-b1bd-1175f6e14329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:28.866488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172058a9-9686-4b29-b1bd-1175f6e14329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:28.868215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172058a9-9686-4b29-b1bd-1175f6e14329 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:28.877404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1342/2662] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:29.216045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e635d-5e32-4946-a09d-da15395ac5b5 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:29.217485 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c10e635d-5e32-4946-a09d-da15395ac5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:29.291813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e635d-5e32-4946-a09d-da15395ac5b5 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:29.296527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2635492752214a33be903b352edb3318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2321f117b7814186b4809cc74a2c5483', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:29.297157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:29.297438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:29.297709 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:29.298401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:29.298698 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:29.300259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:29.315103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1321/2663] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:29.319845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172058a9-9686-4b29-b1bd-1175f6e14329 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:29.330134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172058a9-9686-4b29-b1bd-1175f6e14329 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:29.334598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef69e42-9615-4d66-ab2e-92e0d52f1b92 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2635492752214a33be903b352edb3318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2321f117b7814186b4809cc74a2c5483', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:29.335194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef69e42-9615-4d66-ab2e-92e0d52f1b92 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:29.335483 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef69e42-9615-4d66-ab2e-92e0d52f1b92 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:29.335761 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef69e42-9615-4d66-ab2e-92e0d52f1b92 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:29.336416 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef69e42-9615-4d66-ab2e-92e0d52f1b92 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:29.338331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef69e42-9615-4d66-ab2e-92e0d52f1b92 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:29.468398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:29.468948 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1343/2664] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:29 2022] POST /identity/v3/projects => generated 355 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:29.469683 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:29.471599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef69e42-9615-4d66-ab2e-92e0d52f1b92 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:29.483689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc85d3d-7755-4579-8919-a230ec02b251 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:29.535695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef69e42-9615-4d66-ab2e-92e0d52f1b92 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:29.540488 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30be15-bbfd-4755-8ad9-8eeca8674299 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2635492752214a33be903b352edb3318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2321f117b7814186b4809cc74a2c5483', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:29.541341 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30be15-bbfd-4755-8ad9-8eeca8674299 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:29.541628 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30be15-bbfd-4755-8ad9-8eeca8674299 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:29.541904 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30be15-bbfd-4755-8ad9-8eeca8674299 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:29.542633 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30be15-bbfd-4755-8ad9-8eeca8674299 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:29.542934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30be15-bbfd-4755-8ad9-8eeca8674299 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:29.544538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30be15-bbfd-4755-8ad9-8eeca8674299 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:29.548059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:29.548702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:29.549009 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:29.549282 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] PATH_INFO: `/v3/projects/f89ae435b6bd4f7594efe7d25f049365` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:29.550474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89ae435b6bd4f7594efe7d25f049365)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:29.552359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:29.556959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1344/2665] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:29.580429 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:29.599202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30be15-bbfd-4755-8ad9-8eeca8674299 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:29.609655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30be15-bbfd-4755-8ad9-8eeca8674299 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:29.614162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2635492752214a33be903b352edb3318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2321f117b7814186b4809cc74a2c5483', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:29.614838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:29.615119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:29.615392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] PATH_INFO: `/v3/projects/6296e639780645d6b86ea5136c2b9f15` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:29.617133 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6296e639780645d6b86ea5136c2b9f15)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:29.619011 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:29.680259 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89ae435b6bd4f7594efe7d25f049365', 'request_id': 'req-38f2de31-31eb-4d27-9ecc-eb83a5976659'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.685064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:29.685570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89ae435b6bd4f7594efe7d25f049365', 'request_id': 'req-38f2de31-31eb-4d27-9ecc-eb83a5976659'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.765249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6296e639780645d6b86ea5136c2b9f15', 'request_id': 'req-ef90d2b7-697c-41af-a057-486414465ce9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.799099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89ae435b6bd4f7594efe7d25f049365', 'request_id': 'req-38f2de31-31eb-4d27-9ecc-eb83a5976659'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.811488 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] The token cache is being invalidate because project f89ae435b6bd4f7594efe7d25f049365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:29.817058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.817058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.817058 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1322/2666] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:29 2022] DELETE /identity/v3/projects/f89ae435b6bd4f7594efe7d25f049365 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:29.817810 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:29.819133 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:29.880629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2de31-31eb-4d27-9ecc-eb83a5976659 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:29.934752 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:29.935317 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:29.935598 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:29.935872 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] PATH_INFO: `/v3/users/f48ada3423dc4100bb8bd29826e76aab` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:29.937076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48ada3423dc4100bb8bd29826e76aab)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:29.938977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:29.942124 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6296e639780645d6b86ea5136c2b9f15', 'request_id': 'req-ef90d2b7-697c-41af-a057-486414465ce9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.948167 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6296e639780645d6b86ea5136c2b9f15', 'request_id': 'req-ef90d2b7-697c-41af-a057-486414465ce9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.961900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] The token cache is being invalidate because project 6296e639780645d6b86ea5136c2b9f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:29.962422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.963747 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:29.965464 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1345/2667] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:29 2022] DELETE /identity/v3/projects/6296e639780645d6b86ea5136c2b9f15 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:30.185083 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48ada3423dc4100bb8bd29826e76aab'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:30.185675 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48ada3423dc4100bb8bd29826e76aab'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:30.284449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48ada3423dc4100bb8bd29826e76aab'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:30.285246 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48ada3423dc4100bb8bd29826e76aab'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:30.298182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48ada3423dc4100bb8bd29826e76aab'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:30.310109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1323/2668] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:29 2022] DELETE /identity/v3/users/f48ada3423dc4100bb8bd29826e76aab => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:30.537268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:30.711848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:30.713418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:30.726773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d2b7-697c-41af-a057-486414465ce9 tempest-VolumeQuotaClassesTest-1932572415 tempest-VolumeQuotaClassesTest-1932572415-project-admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:30.776472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:30.779245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:30.782370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:30.783000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:30.783276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:30.783547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] PATH_INFO: `/v3/users/4cb8cf393a2843638595d6f37964a446` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:30.784691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb8cf393a2843638595d6f37964a446)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:30.786655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:30.796041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd674-4b73-461c-87a1-a19403fb0555 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:30.808014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:30.808014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:30.808014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:30.808014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] PATH_INFO: `/v3/projects/3414c4214d7f41389ac54bf24e1de7cf` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:30.808692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3414c4214d7f41389ac54bf24e1de7cf)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:30.808692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:30.950138 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3414c4214d7f41389ac54bf24e1de7cf', 'request_id': 'req-bd5c7927-c914-4aef-b252-03058ff1186d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:30.955626 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3414c4214d7f41389ac54bf24e1de7cf', 'request_id': 'req-bd5c7927-c914-4aef-b252-03058ff1186d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:31.046322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb8cf393a2843638595d6f37964a446'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:31.046905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb8cf393a2843638595d6f37964a446'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:31.054174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb8cf393a2843638595d6f37964a446'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:31.054807 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb8cf393a2843638595d6f37964a446'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:31.066417 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d8ee0d6-6d4a-4e73-bade-119136d83458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb8cf393a2843638595d6f37964a446'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:31.067624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3414c4214d7f41389ac54bf24e1de7cf', 'request_id': 'req-bd5c7927-c914-4aef-b252-03058ff1186d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:31.080298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] The token cache is being invalidate because project 3414c4214d7f41389ac54bf24e1de7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:31.080588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:31.081600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-bd5c7927-c914-4aef-b252-03058ff1186d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:31.083202 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1324/2669] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:30 2022] DELETE /identity/v3/projects/3414c4214d7f41389ac54bf24e1de7cf => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:31.087734 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111efc49-0fee-4e90-bcb9-0184016f0448 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.088020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111efc49-0fee-4e90-bcb9-0184016f0448 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.088297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111efc49-0fee-4e90-bcb9-0184016f0448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.108345 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-111efc49-0fee-4e90-bcb9-0184016f0448 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:31.109572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-111efc49-0fee-4e90-bcb9-0184016f0448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:31.169266 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1325/2670] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:31.177032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b92409-820c-4fab-966b-8c74eea37e02 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.177777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b92409-820c-4fab-966b-8c74eea37e02 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.179056 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b92409-820c-4fab-966b-8c74eea37e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.183232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1346/2671] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:30 2022] DELETE /identity/v3/users/4cb8cf393a2843638595d6f37964a446 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:31.189190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31723b53-bd03-4878-8a8d-568e3d77bf17 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.189545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31723b53-bd03-4878-8a8d-568e3d77bf17 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.189890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31723b53-bd03-4878-8a8d-568e3d77bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.199558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-14b92409-820c-4fab-966b-8c74eea37e02 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:31.200742 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-14b92409-820c-4fab-966b-8c74eea37e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:31.208427 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-31723b53-bd03-4878-8a8d-568e3d77bf17 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:31.209720 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-31723b53-bd03-4878-8a8d-568e3d77bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:31.265372 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1326/2672] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:31.266822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b92409-820c-4fab-966b-8c74eea37e02 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:31.276740 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1347/2673] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:31.279078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b92409-820c-4fab-966b-8c74eea37e02 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:31.283230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31723b53-bd03-4878-8a8d-568e3d77bf17 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:31.284721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fec65-8e81-4751-9776-b6ace5d69c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:31.285243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-31723b53-bd03-4878-8a8d-568e3d77bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:31.285423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fec65-8e81-4751-9776-b6ace5d69c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.285706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fec65-8e81-4751-9776-b6ace5d69c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.286147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fec65-8e81-4751-9776-b6ace5d69c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.287201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fec65-8e81-4751-9776-b6ace5d69c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:31.288217 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fec65-8e81-4751-9776-b6ace5d69c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:31.289976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fec65-8e81-4751-9776-b6ace5d69c58 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:31.302445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1327/2674] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:16:31.307265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fec65-8e81-4751-9776-b6ace5d69c58 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:31.316882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fec65-8e81-4751-9776-b6ace5d69c58 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:31.321660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efacb6-5324-4d89-ae3f-f3c74e848990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:31.322301 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efacb6-5324-4d89-ae3f-f3c74e848990 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.322581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efacb6-5324-4d89-ae3f-f3c74e848990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.322858 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efacb6-5324-4d89-ae3f-f3c74e848990 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.323512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efacb6-5324-4d89-ae3f-f3c74e848990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:31.325428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efacb6-5324-4d89-ae3f-f3c74e848990 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:31.342523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:31.346285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31723b53-bd03-4878-8a8d-568e3d77bf17 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:31.350538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52527-3028-4d06-acd3-3708dfc73a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:31.351165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52527-3028-4d06-acd3-3708dfc73a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.351444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52527-3028-4d06-acd3-3708dfc73a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.351718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52527-3028-4d06-acd3-3708dfc73a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.360642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e52527-3028-4d06-acd3-3708dfc73a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:31.362118 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e52527-3028-4d06-acd3-3708dfc73a76 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:31.372308 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1348/2675] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:31.433331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1328/2676] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:31 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:31.434553 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52527-3028-4d06-acd3-3708dfc73a76 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:31.444814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52527-3028-4d06-acd3-3708dfc73a76 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:31.507159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8919a-32db-4a80-b293-5138288c067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:31.507775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8919a-32db-4a80-b293-5138288c067e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.508055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8919a-32db-4a80-b293-5138288c067e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.508326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8919a-32db-4a80-b293-5138288c067e admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.509015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8919a-32db-4a80-b293-5138288c067e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:31.510909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8919a-32db-4a80-b293-5138288c067e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:31.645267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1349/2677] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:31 2022] POST /identity/v3/users => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:31.649747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efacb6-5324-4d89-ae3f-f3c74e848990 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:31.660539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efacb6-5324-4d89-ae3f-f3c74e848990 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:31.665870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02f26d-cff0-4738-9f5b-5bc7cafd639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:31.666691 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f26d-cff0-4738-9f5b-5bc7cafd639f admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.666981 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f26d-cff0-4738-9f5b-5bc7cafd639f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.667235 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02f26d-cff0-4738-9f5b-5bc7cafd639f admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.667923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02f26d-cff0-4738-9f5b-5bc7cafd639f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:31.669553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02f26d-cff0-4738-9f5b-5bc7cafd639f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:31.679873 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1329/2678] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:31.684933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8919a-32db-4a80-b293-5138288c067e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:31.695254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8919a-32db-4a80-b293-5138288c067e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:31.700731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0610774-a8da-4403-a200-7d8f92f2cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:31.701818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0610774-a8da-4403-a200-7d8f92f2cb4f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.701818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0610774-a8da-4403-a200-7d8f92f2cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.716189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0610774-a8da-4403-a200-7d8f92f2cb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.716189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0610774-a8da-4403-a200-7d8f92f2cb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:31.716189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0610774-a8da-4403-a200-7d8f92f2cb4f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:31.716189 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1350/2679] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:31.719315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02f26d-cff0-4738-9f5b-5bc7cafd639f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:31.729787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02f26d-cff0-4738-9f5b-5bc7cafd639f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:31.734366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d8a6a-1d74-4a09-b30e-c4af84e28340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:31.735018 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d8a6a-1d74-4a09-b30e-c4af84e28340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.735297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d8a6a-1d74-4a09-b30e-c4af84e28340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.735570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d8a6a-1d74-4a09-b30e-c4af84e28340 admin admin] PATH_INFO: `/v3/projects/7eaf777718a84e0aaf63d48c0c9b1028/users/d98f4e1591f2424c979414f15109328a/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.750697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d8a6a-1d74-4a09-b30e-c4af84e28340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eaf777718a84e0aaf63d48c0c9b1028, user_id=d98f4e1591f2424c979414f15109328a, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:31.753436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d8a6a-1d74-4a09-b30e-c4af84e28340 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:31.815972 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:31.890642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1330/2680] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:31 2022] PUT /identity/v3/projects/7eaf777718a84e0aaf63d48c0c9b1028/users/d98f4e1591f2424c979414f15109328a/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:31.901787 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d02f-5753-4491-ad1e-c612e8b2d4c8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:31.912863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d02f-5753-4491-ad1e-c612e8b2d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:31.912863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d02f-5753-4491-ad1e-c612e8b2d4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:31.929705 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6d70d02f-5753-4491-ad1e-c612e8b2d4c8 None None] MFA Rules not processed for user `d98f4e1591f2424c979414f15109328a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:31.930916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6d70d02f-5753-4491-ad1e-c612e8b2d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:31.955286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d8a6a-1d74-4a09-b30e-c4af84e28340 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:31.957066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-616d8a6a-1d74-4a09-b30e-c4af84e28340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:32.005358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1351/2681] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:32.010691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70d02f-5753-4491-ad1e-c612e8b2d4c8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:32.034037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d8a6a-1d74-4a09-b30e-c4af84e28340 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:32.038900 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:32.039541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.039967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.040098 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] PATH_INFO: `/v3/projects/0ce59a73b74042d8a60a40f6fd565441` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.041320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce59a73b74042d8a60a40f6fd565441)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:32.043252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:32.100746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70d02f-5753-4491-ad1e-c612e8b2d4c8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:32.100746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83e07a-dfa6-4207-95df-0432477333fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:32.100746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83e07a-dfa6-4207-95df-0432477333fa admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.100746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83e07a-dfa6-4207-95df-0432477333fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.115157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83e07a-dfa6-4207-95df-0432477333fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.115157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83e07a-dfa6-4207-95df-0432477333fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:32.115157 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83e07a-dfa6-4207-95df-0432477333fa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:32.218687 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce59a73b74042d8a60a40f6fd565441', 'request_id': 'req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.224069 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce59a73b74042d8a60a40f6fd565441', 'request_id': 'req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.234566 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1352/2682] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:32 2022] POST /identity/v3/projects => generated 399 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:32.238589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83e07a-dfa6-4207-95df-0432477333fa admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:32.300201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83e07a-dfa6-4207-95df-0432477333fa admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:32.302251 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce59a73b74042d8a60a40f6fd565441', 'request_id': 'req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.305455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a6ae3-b095-486c-8618-8e99cd2f9735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:32.306098 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a6ae3-b095-486c-8618-8e99cd2f9735 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.306378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a6ae3-b095-486c-8618-8e99cd2f9735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.306651 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a6ae3-b095-486c-8618-8e99cd2f9735 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.307353 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a6ae3-b095-486c-8618-8e99cd2f9735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:32.309573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a6ae3-b095-486c-8618-8e99cd2f9735 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:32.315278 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:32.320469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] The token cache is being invalidate because project 0ce59a73b74042d8a60a40f6fd565441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:32.320898 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.321870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.323774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1331/2683] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:31 2022] DELETE /identity/v3/projects/0ce59a73b74042d8a60a40f6fd565441 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:32.327451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:32.328991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:32.391908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95c82d-f475-4c9d-9e2e-596afb8c5da0 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:32.396885 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:32.397533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.398016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.398523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] PATH_INFO: `/v3/users/2635492752214a33be903b352edb3318` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.400522 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2635492752214a33be903b352edb3318)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:32.402537 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:32.408120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1353/2684] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:32 2022] POST /identity/v3/users => generated 306 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:32.409193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a6ae3-b095-486c-8618-8e99cd2f9735 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:32.410819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-939a6ae3-b095-486c-8618-8e99cd2f9735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:32.423158 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a6ae3-b095-486c-8618-8e99cd2f9735 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:32.427959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11877a8-9ca1-4f53-b33c-e041f5eaff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:32.429072 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11877a8-9ca1-4f53-b33c-e041f5eaff90 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.429348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11877a8-9ca1-4f53-b33c-e041f5eaff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.429617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11877a8-9ca1-4f53-b33c-e041f5eaff90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.430311 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11877a8-9ca1-4f53-b33c-e041f5eaff90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:32.431884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11877a8-9ca1-4f53-b33c-e041f5eaff90 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:32.441693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1354/2685] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:32.446403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11877a8-9ca1-4f53-b33c-e041f5eaff90 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:32.455616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11877a8-9ca1-4f53-b33c-e041f5eaff90 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:32.460337 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0c325-9147-4f13-a2f9-1a641274a577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:32.461075 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0c325-9147-4f13-a2f9-1a641274a577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.471446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0c325-9147-4f13-a2f9-1a641274a577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.471446 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0c325-9147-4f13-a2f9-1a641274a577 admin admin] PATH_INFO: `/v3/projects/ed898069074a40109c1da4acac7b5b1d/users/32d99a4ce7654b36a5339c302e03fee5/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.476194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0c325-9147-4f13-a2f9-1a641274a577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed898069074a40109c1da4acac7b5b1d, user_id=32d99a4ce7654b36a5339c302e03fee5, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:32.478874 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0c325-9147-4f13-a2f9-1a641274a577 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:32.559768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1355/2686] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:32 2022] PUT /identity/v3/projects/ed898069074a40109c1da4acac7b5b1d/users/32d99a4ce7654b36a5339c302e03fee5/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:32.563767 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0c325-9147-4f13-a2f9-1a641274a577 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:32.627395 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0c325-9147-4f13-a2f9-1a641274a577 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:32.633204 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a4ce1-44b3-499e-8a8f-374639567cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:32.633812 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a4ce1-44b3-499e-8a8f-374639567cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.634091 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a4ce1-44b3-499e-8a8f-374639567cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.634396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a4ce1-44b3-499e-8a8f-374639567cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.635053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a4ce1-44b3-499e-8a8f-374639567cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:32.636674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a4ce1-44b3-499e-8a8f-374639567cb5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:32.638131 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2635492752214a33be903b352edb3318'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.639001 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2635492752214a33be903b352edb3318'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.646949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1356/2687] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:32.651115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a4ce1-44b3-499e-8a8f-374639567cb5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:32.660381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a4ce1-44b3-499e-8a8f-374639567cb5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:32.665656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc115e-e4f7-4a5f-ab02-f70a531845c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:32.666271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc115e-e4f7-4a5f-ab02-f70a531845c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.666551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc115e-e4f7-4a5f-ab02-f70a531845c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.666824 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc115e-e4f7-4a5f-ab02-f70a531845c3 admin admin] PATH_INFO: `/v3/projects/ed898069074a40109c1da4acac7b5b1d/users/32d99a4ce7654b36a5339c302e03fee5/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.668743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc115e-e4f7-4a5f-ab02-f70a531845c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed898069074a40109c1da4acac7b5b1d, user_id=32d99a4ce7654b36a5339c302e03fee5, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:32.671347 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc115e-e4f7-4a5f-ab02-f70a531845c3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:32.685501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1357/2688] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:32 2022] PUT /identity/v3/projects/ed898069074a40109c1da4acac7b5b1d/users/32d99a4ce7654b36a5339c302e03fee5/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:32.694506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8426582-4f67-45ee-8b73-9cd3edf33e0c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.694854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8426582-4f67-45ee-8b73-9cd3edf33e0c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.695117 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8426582-4f67-45ee-8b73-9cd3edf33e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.723630 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a8426582-4f67-45ee-8b73-9cd3edf33e0c None None] MFA Rules not processed for user `32d99a4ce7654b36a5339c302e03fee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:32.724864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a8426582-4f67-45ee-8b73-9cd3edf33e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:32.737064 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2635492752214a33be903b352edb3318'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.740467 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:32.741591 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2635492752214a33be903b352edb3318'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.755112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2635492752214a33be903b352edb3318'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:32.767464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1332/2689] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:32 2022] DELETE /identity/v3/users/2635492752214a33be903b352edb3318 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:32.806086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1358/2690] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:32.817192 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:32.818628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:32.886097 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d93b47-8596-4a71-b638-8d29682ee79f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:32.887291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d6fe2-bb03-44ca-ae8a-31fdbefcfe43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:32.887902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d6fe2-bb03-44ca-ae8a-31fdbefcfe43 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:32.888207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d6fe2-bb03-44ca-ae8a-31fdbefcfe43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:32.888481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d6fe2-bb03-44ca-ae8a-31fdbefcfe43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:32.948329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d6fe2-bb03-44ca-ae8a-31fdbefcfe43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:32.949723 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d6fe2-bb03-44ca-ae8a-31fdbefcfe43 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:32.959114 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1333/2691] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:33.261424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8426582-4f67-45ee-8b73-9cd3edf33e0c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:33.263000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a8426582-4f67-45ee-8b73-9cd3edf33e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:33.311342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d6fe2-bb03-44ca-ae8a-31fdbefcfe43 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:33.320093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d6fe2-bb03-44ca-ae8a-31fdbefcfe43 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:33.323740 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea3fb2-11b1-46d2-939c-2964a2740136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:33.324337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea3fb2-11b1-46d2-939c-2964a2740136 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:33.324609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea3fb2-11b1-46d2-939c-2964a2740136 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:33.324908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea3fb2-11b1-46d2-939c-2964a2740136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:33.326664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-22ea3fb2-11b1-46d2-939c-2964a2740136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:33.339790 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8426582-4f67-45ee-8b73-9cd3edf33e0c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:33.390893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea3fb2-11b1-46d2-939c-2964a2740136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:33.393820 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea3fb2-11b1-46d2-939c-2964a2740136 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:33.410884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1334/2692] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:33.412221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:33.413316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:33.413821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:33.414319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] PATH_INFO: `/v3/projects/2321f117b7814186b4809cc74a2c5483` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:33.415940 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2321f117b7814186b4809cc74a2c5483)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:33.418797 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:33.479547 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:33.532722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2321f117b7814186b4809cc74a2c5483', 'request_id': 'req-7835863c-7357-42df-8419-4eb2d294a70e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:33.605002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2321f117b7814186b4809cc74a2c5483', 'request_id': 'req-7835863c-7357-42df-8419-4eb2d294a70e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:33.610950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2321f117b7814186b4809cc74a2c5483', 'request_id': 'req-7835863c-7357-42df-8419-4eb2d294a70e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:33.621802 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] The token cache is being invalidate because project 2321f117b7814186b4809cc74a2c5483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:33.622088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:33.622718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7835863c-7357-42df-8419-4eb2d294a70e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:33.624218 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1359/2693] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:33 2022] DELETE /identity/v3/projects/2321f117b7814186b4809cc74a2c5483 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:33.629911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91435e3f-99d8-433a-8ddd-dc21d9d7fd1a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:33.630198 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91435e3f-99d8-433a-8ddd-dc21d9d7fd1a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:33.630474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91435e3f-99d8-433a-8ddd-dc21d9d7fd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:33.652369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-91435e3f-99d8-433a-8ddd-dc21d9d7fd1a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:33.653622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-91435e3f-99d8-433a-8ddd-dc21d9d7fd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:33.729276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1335/2694] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:33.737528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b5a73-5f8e-466c-8cf6-fd5e16c64ccd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:33.738009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b5a73-5f8e-466c-8cf6-fd5e16c64ccd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:33.738716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b5a73-5f8e-466c-8cf6-fd5e16c64ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:33.759392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d59b5a73-5f8e-466c-8cf6-fd5e16c64ccd None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:33.760693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d59b5a73-5f8e-466c-8cf6-fd5e16c64ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:33.769545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1360/2695] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:33.774642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91435e3f-99d8-433a-8ddd-dc21d9d7fd1a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:33.786147 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91435e3f-99d8-433a-8ddd-dc21d9d7fd1a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:33.796354 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57219259-e1bf-45f0-8527-924fa5a49af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:33.796822 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57219259-e1bf-45f0-8527-924fa5a49af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:33.797178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57219259-e1bf-45f0-8527-924fa5a49af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:33.797519 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57219259-e1bf-45f0-8527-924fa5a49af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:33.798327 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57219259-e1bf-45f0-8527-924fa5a49af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:33.798700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57219259-e1bf-45f0-8527-924fa5a49af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:33.800403 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57219259-e1bf-45f0-8527-924fa5a49af8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:33.812683 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1336/2696] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:33.817237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b5a73-5f8e-466c-8cf6-fd5e16c64ccd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:33.826570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b5a73-5f8e-466c-8cf6-fd5e16c64ccd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:33.831351 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0d0ee-826c-4288-a619-f8d030572d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:33.832071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0d0ee-826c-4288-a619-f8d030572d62 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:33.832352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0d0ee-826c-4288-a619-f8d030572d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:33.832621 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0d0ee-826c-4288-a619-f8d030572d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:33.833326 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0d0ee-826c-4288-a619-f8d030572d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:33.836318 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0d0ee-826c-4288-a619-f8d030572d62 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:34.013609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1361/2697] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:33 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:34.018514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57219259-e1bf-45f0-8527-924fa5a49af8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:34.028411 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57219259-e1bf-45f0-8527-924fa5a49af8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:34.083433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171b13c-5cd1-4999-8509-dfec81a3f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:34.084044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171b13c-5cd1-4999-8509-dfec81a3f4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:34.087501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171b13c-5cd1-4999-8509-dfec81a3f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:34.087501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171b13c-5cd1-4999-8509-dfec81a3f4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:34.087501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171b13c-5cd1-4999-8509-dfec81a3f4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:34.087501 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171b13c-5cd1-4999-8509-dfec81a3f4a6 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:34.239320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1337/2698] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:34 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:34.243718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0d0ee-826c-4288-a619-f8d030572d62 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:34.254036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0d0ee-826c-4288-a619-f8d030572d62 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:34.258711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8605608-455e-43e4-a6ab-8400d9f7b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:34.260151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8605608-455e-43e4-a6ab-8400d9f7b7fe admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:34.260151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8605608-455e-43e4-a6ab-8400d9f7b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:34.260151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8605608-455e-43e4-a6ab-8400d9f7b7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:34.260544 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8605608-455e-43e4-a6ab-8400d9f7b7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:34.262210 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8605608-455e-43e4-a6ab-8400d9f7b7fe admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:34.272137 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1362/2699] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:34.276154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171b13c-5cd1-4999-8509-dfec81a3f4a6 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:34.286084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171b13c-5cd1-4999-8509-dfec81a3f4a6 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:34.291175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d24c0-2036-4fc5-bb62-1b472e3eb868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:34.291772 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d24c0-2036-4fc5-bb62-1b472e3eb868 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:34.292055 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d24c0-2036-4fc5-bb62-1b472e3eb868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:34.292329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d24c0-2036-4fc5-bb62-1b472e3eb868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:34.293047 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d24c0-2036-4fc5-bb62-1b472e3eb868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:34.300177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d24c0-2036-4fc5-bb62-1b472e3eb868 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:34.306753 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1338/2700] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:34.310087 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8605608-455e-43e4-a6ab-8400d9f7b7fe admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:34.327625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8605608-455e-43e4-a6ab-8400d9f7b7fe admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:34.335304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef10efc-4c05-41ac-b1a8-debf12b9e60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:34.336410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef10efc-4c05-41ac-b1a8-debf12b9e60a admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:34.336993 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef10efc-4c05-41ac-b1a8-debf12b9e60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:34.337276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef10efc-4c05-41ac-b1a8-debf12b9e60a admin admin] PATH_INFO: `/v3/projects/e2bce721a0de4b6295d59f5f33c62742/users/042384f02b1b4b9fa1fce813cdc607b3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:34.352143 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef10efc-4c05-41ac-b1a8-debf12b9e60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2bce721a0de4b6295d59f5f33c62742, user_id=042384f02b1b4b9fa1fce813cdc607b3, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:34.355122 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef10efc-4c05-41ac-b1a8-debf12b9e60a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:34.416617 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:34.473482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1363/2701] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:34 2022] PUT /identity/v3/projects/e2bce721a0de4b6295d59f5f33c62742/users/042384f02b1b4b9fa1fce813cdc607b3/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:34.487121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceae440-4f9c-4cf0-87c8-69307691f1f0 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:34.487409 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceae440-4f9c-4cf0-87c8-69307691f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:34.487681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceae440-4f9c-4cf0-87c8-69307691f1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:34.518708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-6ceae440-4f9c-4cf0-87c8-69307691f1f0 None None] MFA Rules not processed for user `042384f02b1b4b9fa1fce813cdc607b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:34.519934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6ceae440-4f9c-4cf0-87c8-69307691f1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:34.587414 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:34.589466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1339/2702] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:34.602296 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef10efc-4c05-41ac-b1a8-debf12b9e60a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:34.603981 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0ef10efc-4c05-41ac-b1a8-debf12b9e60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:34.668384 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef10efc-4c05-41ac-b1a8-debf12b9e60a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:34.672552 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b378-1264-4ddf-8898-44f9acbeb3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:34.673509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b378-1264-4ddf-8898-44f9acbeb3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:34.673798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b378-1264-4ddf-8898-44f9acbeb3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:34.674073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b378-1264-4ddf-8898-44f9acbeb3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:34.683765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5b378-1264-4ddf-8898-44f9acbeb3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:34.685362 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5b378-1264-4ddf-8898-44f9acbeb3b3 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:34.695319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1364/2703] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:34.716458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceae440-4f9c-4cf0-87c8-69307691f1f0 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:34.777367 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceae440-4f9c-4cf0-87c8-69307691f1f0 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:34.781979 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:34.782609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:34.782891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:34.783166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] PATH_INFO: `/v3/users/042384f02b1b4b9fa1fce813cdc607b3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:34.784329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=042384f02b1b4b9fa1fce813cdc607b3)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:34.786297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:35.065586 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042384f02b1b4b9fa1fce813cdc607b3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:35.066179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042384f02b1b4b9fa1fce813cdc607b3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:35.165079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042384f02b1b4b9fa1fce813cdc607b3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:35.166057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042384f02b1b4b9fa1fce813cdc607b3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:35.181688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042384f02b1b4b9fa1fce813cdc607b3'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:35.194371 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1340/2704] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:34 2022] DELETE /identity/v3/users/042384f02b1b4b9fa1fce813cdc607b3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:35.198952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97d08b-817a-42f6-af59-dc11f88f49ae None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:35.199461 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97d08b-817a-42f6-af59-dc11f88f49ae None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:35.199569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97d08b-817a-42f6-af59-dc11f88f49ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:35.219820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9b97d08b-817a-42f6-af59-dc11f88f49ae None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:35.221457 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9b97d08b-817a-42f6-af59-dc11f88f49ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:35.283383 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1365/2705] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:35.293823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:35.295298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:35.352932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb163a-fa0b-4e39-afd3-b4c8975fdf9a admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:35.356523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822096f-4565-4699-a9da-f4f2512f19ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:35.357295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822096f-4565-4699-a9da-f4f2512f19ce service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:35.357575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822096f-4565-4699-a9da-f4f2512f19ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:35.357841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822096f-4565-4699-a9da-f4f2512f19ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:35.368257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822096f-4565-4699-a9da-f4f2512f19ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:35.369867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822096f-4565-4699-a9da-f4f2512f19ce service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:35.380122 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1341/2706] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:35.914135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:35.984313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97d08b-817a-42f6-af59-dc11f88f49ae None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:35.985887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9b97d08b-817a-42f6-af59-dc11f88f49ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:35.999120 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97d08b-817a-42f6-af59-dc11f88f49ae None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:36.004671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:36.005434 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:36.005778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:36.006115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] PATH_INFO: `/v3/projects/e2bce721a0de4b6295d59f5f33c62742` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:36.007620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2bce721a0de4b6295d59f5f33c62742)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:36.009607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:36.142081 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2bce721a0de4b6295d59f5f33c62742', 'request_id': 'req-29dca14f-b211-472b-8505-aa47626aaff0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:36.174391 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:36.325285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2bce721a0de4b6295d59f5f33c62742', 'request_id': 'req-29dca14f-b211-472b-8505-aa47626aaff0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:36.333516 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2bce721a0de4b6295d59f5f33c62742', 'request_id': 'req-29dca14f-b211-472b-8505-aa47626aaff0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:36.346208 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] The token cache is being invalidate because project e2bce721a0de4b6295d59f5f33c62742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:36.346418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:36.347129 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-29dca14f-b211-472b-8505-aa47626aaff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:36.348555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1366/2707] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:35 2022] DELETE /identity/v3/projects/e2bce721a0de4b6295d59f5f33c62742 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:36.354761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a286-a306-4b3e-bcff-d38ce6e9eac5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:36.354761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a286-a306-4b3e-bcff-d38ce6e9eac5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:36.354761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a286-a306-4b3e-bcff-d38ce6e9eac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:36.381891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ab90a286-a306-4b3e-bcff-d38ce6e9eac5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:36.383096 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ab90a286-a306-4b3e-bcff-d38ce6e9eac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:36.440980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1342/2708] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:36.450258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fe55d-7b72-4554-86a5-41920b7e0380 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:36.450800 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fe55d-7b72-4554-86a5-41920b7e0380 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:36.451321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fe55d-7b72-4554-86a5-41920b7e0380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:36.474810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5b2fe55d-7b72-4554-86a5-41920b7e0380 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:36.476027 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5b2fe55d-7b72-4554-86a5-41920b7e0380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:36.484155 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1367/2709] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:36.488384 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a286-a306-4b3e-bcff-d38ce6e9eac5 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:36.498020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a286-a306-4b3e-bcff-d38ce6e9eac5 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:36.502666 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbc0ab-6df7-4e42-b98d-9103aea65090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:36.503265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbc0ab-6df7-4e42-b98d-9103aea65090 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:36.503547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbc0ab-6df7-4e42-b98d-9103aea65090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:36.503818 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbc0ab-6df7-4e42-b98d-9103aea65090 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:36.514206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbc0ab-6df7-4e42-b98d-9103aea65090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:36.514206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbc0ab-6df7-4e42-b98d-9103aea65090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:36.514206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbc0ab-6df7-4e42-b98d-9103aea65090 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:36.519204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1343/2710] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:16:36.524042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fe55d-7b72-4554-86a5-41920b7e0380 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:36.533135 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fe55d-7b72-4554-86a5-41920b7e0380 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:36.537841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c5019-0dbf-4f7c-a039-1e93425ecc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:36.540900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c5019-0dbf-4f7c-a039-1e93425ecc08 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:36.540900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c5019-0dbf-4f7c-a039-1e93425ecc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:36.540900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c5019-0dbf-4f7c-a039-1e93425ecc08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:36.540900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c5019-0dbf-4f7c-a039-1e93425ecc08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:36.541877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c5019-0dbf-4f7c-a039-1e93425ecc08 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:36.675248 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1368/2711] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:36 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:36.679613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbc0ab-6df7-4e42-b98d-9103aea65090 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:36.689375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbc0ab-6df7-4e42-b98d-9103aea65090 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:36.746909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828389-8779-4391-9f63-0d8f583142ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:36.747444 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828389-8779-4391-9f63-0d8f583142ac admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:36.747727 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828389-8779-4391-9f63-0d8f583142ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:36.748004 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc828389-8779-4391-9f63-0d8f583142ac admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:36.748671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc828389-8779-4391-9f63-0d8f583142ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:36.750613 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc828389-8779-4391-9f63-0d8f583142ac admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:36.879806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1344/2712] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:36 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:36.883797 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c5019-0dbf-4f7c-a039-1e93425ecc08 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:36.894789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c5019-0dbf-4f7c-a039-1e93425ecc08 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:36.900199 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7146c-7097-48f5-966b-2cf67bb9cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:36.901019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7146c-7097-48f5-966b-2cf67bb9cc58 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:36.901303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7146c-7097-48f5-966b-2cf67bb9cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:36.901580 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7146c-7097-48f5-966b-2cf67bb9cc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:36.902290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7146c-7097-48f5-966b-2cf67bb9cc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:36.903957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7146c-7097-48f5-966b-2cf67bb9cc58 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:36.915380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1369/2713] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:36.922245 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828389-8779-4391-9f63-0d8f583142ac admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:36.932952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc828389-8779-4391-9f63-0d8f583142ac admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:36.937664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee081e-be90-488d-b3d5-1e8ed65127df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:36.938285 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee081e-be90-488d-b3d5-1e8ed65127df admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:36.938562 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee081e-be90-488d-b3d5-1e8ed65127df admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:36.938832 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee081e-be90-488d-b3d5-1e8ed65127df admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:36.939528 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee081e-be90-488d-b3d5-1e8ed65127df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:36.941358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee081e-be90-488d-b3d5-1e8ed65127df admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:36.952108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1345/2714] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:36.956404 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7146c-7097-48f5-966b-2cf67bb9cc58 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:36.967286 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7146c-7097-48f5-966b-2cf67bb9cc58 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:36.972648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba0c03-76d3-45a0-8914-098b79cf8f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:36.973376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba0c03-76d3-45a0-8914-098b79cf8f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:36.973654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba0c03-76d3-45a0-8914-098b79cf8f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:36.973929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba0c03-76d3-45a0-8914-098b79cf8f9b admin admin] PATH_INFO: `/v3/projects/fb7d7b366f38409c87fca73e874c2968/users/f115b86f662e42c1b56f611d770716be/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:36.982387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:36.989003 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba0c03-76d3-45a0-8914-098b79cf8f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7d7b366f38409c87fca73e874c2968, user_id=f115b86f662e42c1b56f611d770716be, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:36.992377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba0c03-76d3-45a0-8914-098b79cf8f9b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:37.118917 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:37.188065 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1370/2715] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:36 2022] PUT /identity/v3/projects/fb7d7b366f38409c87fca73e874c2968/users/f115b86f662e42c1b56f611d770716be/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:37.198507 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53472f-6c43-4fca-b661-2921859f69d9 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:37.199018 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53472f-6c43-4fca-b661-2921859f69d9 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:37.199108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53472f-6c43-4fca-b661-2921859f69d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:37.228294 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-ec53472f-6c43-4fca-b661-2921859f69d9 None None] MFA Rules not processed for user `f115b86f662e42c1b56f611d770716be`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:37.229556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ec53472f-6c43-4fca-b661-2921859f69d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:37.294874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1346/2716] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:37.307028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba0c03-76d3-45a0-8914-098b79cf8f9b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:37.308725 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9cba0c03-76d3-45a0-8914-098b79cf8f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:37.366842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba0c03-76d3-45a0-8914-098b79cf8f9b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:37.370746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd747a-620a-4c14-bfd6-9bce0fd5b64d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:37.371711 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd747a-620a-4c14-bfd6-9bce0fd5b64d service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:37.371991 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd747a-620a-4c14-bfd6-9bce0fd5b64d service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:37.372261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd747a-620a-4c14-bfd6-9bce0fd5b64d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:37.382687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd747a-620a-4c14-bfd6-9bce0fd5b64d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:37.384958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd747a-620a-4c14-bfd6-9bce0fd5b64d service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:37.394717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1371/2717] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:37.897375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:39.088472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53472f-6c43-4fca-b661-2921859f69d9 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:39.090772 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-ec53472f-6c43-4fca-b661-2921859f69d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:39.166851 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53472f-6c43-4fca-b661-2921859f69d9 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:39.180567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:39.180567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:39.180567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:39.180567 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] PATH_INFO: `/v3/users/624847b30f2e45679762c694e02d1e5d` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:39.181013 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] RBAC: Authorizing `identity:delete_user(user_id=624847b30f2e45679762c694e02d1e5d)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:39.181308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:39.362015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd747a-620a-4c14-bfd6-9bce0fd5b64d service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:39.363485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-52cd747a-620a-4c14-bfd6-9bce0fd5b64d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:39.377682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd747a-620a-4c14-bfd6-9bce0fd5b64d service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:39.382647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:39.383269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:39.383587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:39.383866 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] PATH_INFO: `/v3/users/d98f4e1591f2424c979414f15109328a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:39.385060 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98f4e1591f2424c979414f15109328a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:39.387089 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:39.543654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624847b30f2e45679762c694e02d1e5d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.544300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624847b30f2e45679762c694e02d1e5d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.673580 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624847b30f2e45679762c694e02d1e5d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.674402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624847b30f2e45679762c694e02d1e5d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.689629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-220e9972-32a4-445b-b4f9-8fbff39a657c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624847b30f2e45679762c694e02d1e5d'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.692218 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98f4e1591f2424c979414f15109328a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.693109 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98f4e1591f2424c979414f15109328a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.700881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98f4e1591f2424c979414f15109328a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.701712 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98f4e1591f2424c979414f15109328a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.706093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1347/2718] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:39 2022] DELETE /identity/v3/users/624847b30f2e45679762c694e02d1e5d => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:39.716070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98f4e1591f2424c979414f15109328a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:39.806146 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1372/2719] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:39 2022] DELETE /identity/v3/users/d98f4e1591f2424c979414f15109328a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:39.810588 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a358cd-382a-4a9c-965b-79f14ccb234b None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:39.810916 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a358cd-382a-4a9c-965b-79f14ccb234b None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:39.811200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a358cd-382a-4a9c-965b-79f14ccb234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:39.830440 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c5a358cd-382a-4a9c-965b-79f14ccb234b None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:39.831654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c5a358cd-382a-4a9c-965b-79f14ccb234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:39.860671 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:39.908496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1348/2720] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:39.917999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:39.919386 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:39.973295 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:39.977331 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f676e7-d158-4cba-9b80-3721bbc6b213 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:39.978145 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a358cd-382a-4a9c-965b-79f14ccb234b None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:39.980394 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c5a358cd-382a-4a9c-965b-79f14ccb234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:39.981184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7faa593-d5d8-433e-889e-3c9da1da2550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:39.981859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7faa593-d5d8-433e-889e-3c9da1da2550 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:39.985911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7faa593-d5d8-433e-889e-3c9da1da2550 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:39.985911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7faa593-d5d8-433e-889e-3c9da1da2550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:39.995147 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7faa593-d5d8-433e-889e-3c9da1da2550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:39.996756 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7faa593-d5d8-433e-889e-3c9da1da2550 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:40.003728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a358cd-382a-4a9c-965b-79f14ccb234b None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:40.007920 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1373/2721] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:40.018331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:40.018965 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:40.026173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:40.026173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] PATH_INFO: `/v3/projects/69559b4ae4254130b8c1adbfcb5ecc5f` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:40.026173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69559b4ae4254130b8c1adbfcb5ecc5f)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:40.026173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:40.183778 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69559b4ae4254130b8c1adbfcb5ecc5f', 'request_id': 'req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.189663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69559b4ae4254130b8c1adbfcb5ecc5f', 'request_id': 'req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.320124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69559b4ae4254130b8c1adbfcb5ecc5f', 'request_id': 'req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.337163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] The token cache is being invalidate because project 69559b4ae4254130b8c1adbfcb5ecc5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:40.337283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.337971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.339537 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1349/2722] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:39 2022] DELETE /identity/v3/projects/69559b4ae4254130b8c1adbfcb5ecc5f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:40.344303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7faa593-d5d8-433e-889e-3c9da1da2550 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:40.354573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7faa593-d5d8-433e-889e-3c9da1da2550 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:40.412040 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:40.426637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:40.426637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:40.426637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] PATH_INFO: `/v3/users/46cb662c14854235ad8fab6ed2eedd23` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:40.426637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] RBAC: Authorizing `identity:delete_user(user_id=46cb662c14854235ad8fab6ed2eedd23)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:40.426637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:40.429412 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:40.431721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:40.446628 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6555ad-bea7-4bb4-807b-88f1bedaa2c0 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:40.451993 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:40.452670 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:40.452982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:40.453260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] PATH_INFO: `/v3/projects/7eaf777718a84e0aaf63d48c0c9b1028` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:40.454484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eaf777718a84e0aaf63d48c0c9b1028)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:40.456514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:40.745758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46cb662c14854235ad8fab6ed2eedd23'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.746428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46cb662c14854235ad8fab6ed2eedd23'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.747536 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eaf777718a84e0aaf63d48c0c9b1028', 'request_id': 'req-49f2f46a-4bcf-4368-b511-46b37b074d14'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.753099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46cb662c14854235ad8fab6ed2eedd23'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.753264 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eaf777718a84e0aaf63d48c0c9b1028', 'request_id': 'req-49f2f46a-4bcf-4368-b511-46b37b074d14'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.753754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46cb662c14854235ad8fab6ed2eedd23'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.765131 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46cb662c14854235ad8fab6ed2eedd23'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.890549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eaf777718a84e0aaf63d48c0c9b1028', 'request_id': 'req-49f2f46a-4bcf-4368-b511-46b37b074d14'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.908205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] The token cache is being invalidate because project 7eaf777718a84e0aaf63d48c0c9b1028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:40.908205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.908205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:40.910272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1350/2723] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:40 2022] DELETE /identity/v3/projects/7eaf777718a84e0aaf63d48c0c9b1028 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:40.914197 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:40.915619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:40.965967 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:40.976317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1374/2724] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:40 2022] DELETE /identity/v3/users/46cb662c14854235ad8fab6ed2eedd23 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:41.007383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2f46a-4bcf-4368-b511-46b37b074d14 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:41.071952 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:41.074395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:41.074395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:41.074395 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] PATH_INFO: `/v3/users/32d99a4ce7654b36a5339c302e03fee5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:41.074650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d99a4ce7654b36a5339c302e03fee5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:41.076461 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:41.314758 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:41.316254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:41.330783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43a0c1-188c-4315-a90b-cc9fec7047af admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:41.335571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:41.336216 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:41.336503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:41.336833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] PATH_INFO: `/v3/projects/859ed04436754b4a949066785e254285` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:41.338009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859ed04436754b4a949066785e254285)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:41.339973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:41.402464 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d99a4ce7654b36a5339c302e03fee5'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.403099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d99a4ce7654b36a5339c302e03fee5'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.451222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859ed04436754b4a949066785e254285', 'request_id': 'req-c51b83f8-bf1b-4842-9b6b-aad59d137c40'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.473538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d99a4ce7654b36a5339c302e03fee5'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.474123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d99a4ce7654b36a5339c302e03fee5'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.486732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-780b5b73-60d5-4ac1-a16c-071f13c50071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d99a4ce7654b36a5339c302e03fee5'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.499140 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1351/2725] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:40 2022] DELETE /identity/v3/users/32d99a4ce7654b36a5339c302e03fee5 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:41.593257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859ed04436754b4a949066785e254285', 'request_id': 'req-c51b83f8-bf1b-4842-9b6b-aad59d137c40'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.599524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859ed04436754b4a949066785e254285', 'request_id': 'req-c51b83f8-bf1b-4842-9b6b-aad59d137c40'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.600608 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:41.611108 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] The token cache is being invalidate because project 859ed04436754b4a949066785e254285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:41.611392 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.612035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c51b83f8-bf1b-4842-9b6b-aad59d137c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:41.613593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1375/2726] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:41 2022] DELETE /identity/v3/projects/859ed04436754b4a949066785e254285 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:41.619108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce552ad-5880-4a5b-abaf-e5b87cdfb8ff None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:41.619398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce552ad-5880-4a5b-abaf-e5b87cdfb8ff None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:41.619672 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce552ad-5880-4a5b-abaf-e5b87cdfb8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:41.639323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-4ce552ad-5880-4a5b-abaf-e5b87cdfb8ff None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:41.640515 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-4ce552ad-5880-4a5b-abaf-e5b87cdfb8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:41.698144 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1352/2727] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:41.712551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219f3d5-5774-44d1-a41c-59604b88b5f9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:41.712551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219f3d5-5774-44d1-a41c-59604b88b5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:41.712916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219f3d5-5774-44d1-a41c-59604b88b5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:41.733728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0219f3d5-5774-44d1-a41c-59604b88b5f9 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:41.734963 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0219f3d5-5774-44d1-a41c-59604b88b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:41.743536 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1376/2728] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:41.748109 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce552ad-5880-4a5b-abaf-e5b87cdfb8ff None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:41.758953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce552ad-5880-4a5b-abaf-e5b87cdfb8ff None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:41.764030 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fda0f-f893-4d40-ada9-c0e8e9c84697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:41.764281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fda0f-f893-4d40-ada9-c0e8e9c84697 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:41.764561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fda0f-f893-4d40-ada9-c0e8e9c84697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:41.764874 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fda0f-f893-4d40-ada9-c0e8e9c84697 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:41.765844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fda0f-f893-4d40-ada9-c0e8e9c84697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:41.765974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fda0f-f893-4d40-ada9-c0e8e9c84697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:41.767547 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fda0f-f893-4d40-ada9-c0e8e9c84697 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:41.779353 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1353/2729] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:41.783773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219f3d5-5774-44d1-a41c-59604b88b5f9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:41.793648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219f3d5-5774-44d1-a41c-59604b88b5f9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:41.798549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1c796-5390-4ad1-b720-9910b5c21e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:41.799159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1c796-5390-4ad1-b720-9910b5c21e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:41.799438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1c796-5390-4ad1-b720-9910b5c21e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:41.799710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1c796-5390-4ad1-b720-9910b5c21e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:41.800382 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1c796-5390-4ad1-b720-9910b5c21e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:41.802310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1c796-5390-4ad1-b720-9910b5c21e6b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:41.909080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1377/2730] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:41 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:41.913789 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fda0f-f893-4d40-ada9-c0e8e9c84697 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:41.923752 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fda0f-f893-4d40-ada9-c0e8e9c84697 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:41.938428 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1c796-5390-4ad1-b720-9910b5c21e6b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:41.940769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d2a1c796-5390-4ad1-b720-9910b5c21e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:41.985472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc72c22-b7f6-4ff8-88dd-8ffca3444cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:41.986154 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72c22-b7f6-4ff8-88dd-8ffca3444cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:41.986437 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72c22-b7f6-4ff8-88dd-8ffca3444cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:41.986715 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72c22-b7f6-4ff8-88dd-8ffca3444cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:41.987674 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc72c22-b7f6-4ff8-88dd-8ffca3444cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:41.989415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc72c22-b7f6-4ff8-88dd-8ffca3444cb1 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.016501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1c796-5390-4ad1-b720-9910b5c21e6b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.021642 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.022934 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.023356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.026638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] PATH_INFO: `/v3/projects/ed898069074a40109c1da4acac7b5b1d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.026638 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed898069074a40109c1da4acac7b5b1d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.027229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.109304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1354/2731] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:41 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:42.114428 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc72c22-b7f6-4ff8-88dd-8ffca3444cb1 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.124185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc72c22-b7f6-4ff8-88dd-8ffca3444cb1 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.129094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dfce7-0a30-4728-8a42-a2a5a02d0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.129706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dfce7-0a30-4728-8a42-a2a5a02d0e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.129990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dfce7-0a30-4728-8a42-a2a5a02d0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.130267 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dfce7-0a30-4728-8a42-a2a5a02d0e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.131039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dfce7-0a30-4728-8a42-a2a5a02d0e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.132631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dfce7-0a30-4728-8a42-a2a5a02d0e01 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.143693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1355/2732] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:42.148342 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dfce7-0a30-4728-8a42-a2a5a02d0e01 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.159328 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dfce7-0a30-4728-8a42-a2a5a02d0e01 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.165579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1622ec-b64e-410e-9cff-7e0ef1346447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.166199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1622ec-b64e-410e-9cff-7e0ef1346447 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.166651 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1622ec-b64e-410e-9cff-7e0ef1346447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.168920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1622ec-b64e-410e-9cff-7e0ef1346447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.168920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1622ec-b64e-410e-9cff-7e0ef1346447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.169240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1622ec-b64e-410e-9cff-7e0ef1346447 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.180046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1356/2733] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:42.184291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1622ec-b64e-410e-9cff-7e0ef1346447 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.194366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1622ec-b64e-410e-9cff-7e0ef1346447 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.205250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed898069074a40109c1da4acac7b5b1d', 'request_id': 'req-069d433c-507e-468d-8c89-50098de0641b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:42.257165 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a204440-8082-44fa-98c7-3f47bd0edd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.257837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204440-8082-44fa-98c7-3f47bd0edd83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.258148 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204440-8082-44fa-98c7-3f47bd0edd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.258396 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204440-8082-44fa-98c7-3f47bd0edd83 admin admin] PATH_INFO: `/v3/projects/ffe8d4c3488a48a9b68ed086999783e4/users/fb474c91848c44fc8b604c533593d472/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.274909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204440-8082-44fa-98c7-3f47bd0edd83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe8d4c3488a48a9b68ed086999783e4, user_id=fb474c91848c44fc8b604c533593d472, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.278579 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204440-8082-44fa-98c7-3f47bd0edd83 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.337097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed898069074a40109c1da4acac7b5b1d', 'request_id': 'req-069d433c-507e-468d-8c89-50098de0641b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:42.337260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:42.344063 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed898069074a40109c1da4acac7b5b1d', 'request_id': 'req-069d433c-507e-468d-8c89-50098de0641b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:42.355962 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] The token cache is being invalidate because project ed898069074a40109c1da4acac7b5b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:42.356238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:42.356929 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-069d433c-507e-468d-8c89-50098de0641b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:42.358472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1378/2734] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:41 2022] DELETE /identity/v3/projects/ed898069074a40109c1da4acac7b5b1d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:42.363061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252b403-20fd-4eaa-8c36-165b379ba665 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.363352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252b403-20fd-4eaa-8c36-165b379ba665 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.363631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252b403-20fd-4eaa-8c36-165b379ba665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.382798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6252b403-20fd-4eaa-8c36-165b379ba665 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:42.383959 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6252b403-20fd-4eaa-8c36-165b379ba665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:42.392363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1379/2735] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:42.400338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4713d-3028-4d9c-8e0a-876ddd6bb28a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.400644 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4713d-3028-4d9c-8e0a-876ddd6bb28a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.400977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4713d-3028-4d9c-8e0a-876ddd6bb28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.419355 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-64f4713d-3028-4d9c-8e0a-876ddd6bb28a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:42.420534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-64f4713d-3028-4d9c-8e0a-876ddd6bb28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:42.428348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1380/2736] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:42.435859 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4713d-3028-4d9c-8e0a-876ddd6bb28a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.445449 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4713d-3028-4d9c-8e0a-876ddd6bb28a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.451253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1357/2737] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:42 2022] PUT /identity/v3/projects/ffe8d4c3488a48a9b68ed086999783e4/users/fb474c91848c44fc8b604c533593d472/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:42.463143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a96ad-b811-4bf8-ad63-aeb3702c7849 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.463436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a96ad-b811-4bf8-ad63-aeb3702c7849 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.463713 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a96ad-b811-4bf8-ad63-aeb3702c7849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.491804 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a26a96ad-b811-4bf8-ad63-aeb3702c7849 None None] MFA Rules not processed for user `fb474c91848c44fc8b604c533593d472`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:42.493218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a26a96ad-b811-4bf8-ad63-aeb3702c7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:42.505585 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5767f-3d1a-4a21-9f98-92c66ab5ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.506710 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5767f-3d1a-4a21-9f98-92c66ab5ef38 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.506996 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5767f-3d1a-4a21-9f98-92c66ab5ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.507368 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5767f-3d1a-4a21-9f98-92c66ab5ef38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.507961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5767f-3d1a-4a21-9f98-92c66ab5ef38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:42.508266 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5767f-3d1a-4a21-9f98-92c66ab5ef38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.509897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5767f-3d1a-4a21-9f98-92c66ab5ef38 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.521692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1381/2738] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:16:42.526877 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5767f-3d1a-4a21-9f98-92c66ab5ef38 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.536868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5767f-3d1a-4a21-9f98-92c66ab5ef38 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.542551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8c030-5d0a-4b28-b061-bf5abe26c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.543168 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8c030-5d0a-4b28-b061-bf5abe26c719 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.543443 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8c030-5d0a-4b28-b061-bf5abe26c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.543704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8c030-5d0a-4b28-b061-bf5abe26c719 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.544374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8c030-5d0a-4b28-b061-bf5abe26c719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.546344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8c030-5d0a-4b28-b061-bf5abe26c719 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.565852 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1358/2739] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:42.651143 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a96ad-b811-4bf8-ad63-aeb3702c7849 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.653394 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a26a96ad-b811-4bf8-ad63-aeb3702c7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:42.670671 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1382/2740] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:42 2022] POST /identity/v3/projects => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:42.674780 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8c030-5d0a-4b28-b061-bf5abe26c719 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.716860 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a96ad-b811-4bf8-ad63-aeb3702c7849 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.745127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:42.750125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8c030-5d0a-4b28-b061-bf5abe26c719 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.754436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d8de-8532-4984-b96c-d128b9f11871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.755106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d8de-8532-4984-b96c-d128b9f11871 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.755388 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d8de-8532-4984-b96c-d128b9f11871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.755741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d8de-8532-4984-b96c-d128b9f11871 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.756950 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4d8de-8532-4984-b96c-d128b9f11871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.758868 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4d8de-8532-4984-b96c-d128b9f11871 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.771855 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e077eb8-4df0-4e0a-8cab-90c4737e900e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.772545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e077eb8-4df0-4e0a-8cab-90c4737e900e service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.772982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e077eb8-4df0-4e0a-8cab-90c4737e900e service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.773106 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e077eb8-4df0-4e0a-8cab-90c4737e900e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.830683 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e077eb8-4df0-4e0a-8cab-90c4737e900e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.832121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e077eb8-4df0-4e0a-8cab-90c4737e900e service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.841539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1359/2741] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:42.859042 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1383/2742] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:42 2022] POST /identity/v3/users => generated 281 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:42.861817 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e077eb8-4df0-4e0a-8cab-90c4737e900e service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.873329 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e077eb8-4df0-4e0a-8cab-90c4737e900e service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.878991 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413018b1-4083-4ef4-bdd9-73815d1003a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.879610 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413018b1-4083-4ef4-bdd9-73815d1003a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.879913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413018b1-4083-4ef4-bdd9-73815d1003a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.880200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413018b1-4083-4ef4-bdd9-73815d1003a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.881037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413018b1-4083-4ef4-bdd9-73815d1003a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.883631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413018b1-4083-4ef4-bdd9-73815d1003a5 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.894529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1360/2743] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:42.898616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d8de-8532-4984-b96c-d128b9f11871 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.909336 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d8de-8532-4984-b96c-d128b9f11871 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.913864 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4605a7-0426-46f4-b7a7-f09279faa31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.914465 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4605a7-0426-46f4-b7a7-f09279faa31c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.914778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4605a7-0426-46f4-b7a7-f09279faa31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.915056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4605a7-0426-46f4-b7a7-f09279faa31c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.915774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4605a7-0426-46f4-b7a7-f09279faa31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.917517 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4605a7-0426-46f4-b7a7-f09279faa31c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:42.928715 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1384/2744] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:42.932906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413018b1-4083-4ef4-bdd9-73815d1003a5 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:42.940978 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:42.945581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413018b1-4083-4ef4-bdd9-73815d1003a5 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:42.950319 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277abc3-46a8-491d-ab99-a6dc999d1ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:42.951040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277abc3-46a8-491d-ab99-a6dc999d1ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:42.951442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277abc3-46a8-491d-ab99-a6dc999d1ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:42.951784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277abc3-46a8-491d-ab99-a6dc999d1ed0 admin admin] PATH_INFO: `/v3/projects/b5127edeead64044a25c3ff9d4c27994/users/8557e5a7999c4c45a728eeece43eb050/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:42.966939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277abc3-46a8-491d-ab99-a6dc999d1ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5127edeead64044a25c3ff9d4c27994, user_id=8557e5a7999c4c45a728eeece43eb050, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:42.970206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277abc3-46a8-491d-ab99-a6dc999d1ed0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:43.084942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1361/2745] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:42 2022] PUT /identity/v3/projects/b5127edeead64044a25c3ff9d4c27994/users/8557e5a7999c4c45a728eeece43eb050/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:43.095518 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15074b-5568-4914-bbe6-37ec8bba79c4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:43.095828 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15074b-5568-4914-bbe6-37ec8bba79c4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:43.096112 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15074b-5568-4914-bbe6-37ec8bba79c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:43.126220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3f15074b-5568-4914-bbe6-37ec8bba79c4 None None] MFA Rules not processed for user `8557e5a7999c4c45a728eeece43eb050`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:43.127524 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3f15074b-5568-4914-bbe6-37ec8bba79c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:43.200269 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1385/2746] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:43.235250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277abc3-46a8-491d-ab99-a6dc999d1ed0 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:43.237113 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-0277abc3-46a8-491d-ab99-a6dc999d1ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:43.274057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:43.306925 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277abc3-46a8-491d-ab99-a6dc999d1ed0 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:43.310750 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96e64d-ffd3-4004-924f-3b5ac277bf1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:43.311386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96e64d-ffd3-4004-924f-3b5ac277bf1a service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:43.311868 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96e64d-ffd3-4004-924f-3b5ac277bf1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:43.312149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96e64d-ffd3-4004-924f-3b5ac277bf1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:43.320951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96e64d-ffd3-4004-924f-3b5ac277bf1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:43.322383 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96e64d-ffd3-4004-924f-3b5ac277bf1a service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:43.331410 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1362/2747] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:43.346814 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15074b-5568-4914-bbe6-37ec8bba79c4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:43.376485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:43.414281 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15074b-5568-4914-bbe6-37ec8bba79c4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:43.418933 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:43.419569 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:43.419850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:43.420121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] PATH_INFO: `/v3/users/8557e5a7999c4c45a728eeece43eb050` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:43.421332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8557e5a7999c4c45a728eeece43eb050)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:43.423242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:43.591130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8557e5a7999c4c45a728eeece43eb050'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:43.592136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8557e5a7999c4c45a728eeece43eb050'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:43.600527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8557e5a7999c4c45a728eeece43eb050'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:43.601338 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8557e5a7999c4c45a728eeece43eb050'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:43.613799 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8557e5a7999c4c45a728eeece43eb050'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:43.674700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1386/2748] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:43 2022] DELETE /identity/v3/users/8557e5a7999c4c45a728eeece43eb050 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:43.679222 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031a648-32ea-4c64-badd-5ef7b48e3e93 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:43.679704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031a648-32ea-4c64-badd-5ef7b48e3e93 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:43.685859 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031a648-32ea-4c64-badd-5ef7b48e3e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:43.698693 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a031a648-32ea-4c64-badd-5ef7b48e3e93 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:43.699907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a031a648-32ea-4c64-badd-5ef7b48e3e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:43.731374 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:43.733095 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:43.770585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1363/2749] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:43.781612 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031a648-32ea-4c64-badd-5ef7b48e3e93 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:43.783053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a031a648-32ea-4c64-badd-5ef7b48e3e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:43.805243 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f946bb-f00f-46bf-a9cd-37837e995537 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:43.810506 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:43.811152 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:43.811436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:43.811708 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] PATH_INFO: `/v3/users/981ff5ea531b46f980661ecbae69c93b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:43.813140 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=981ff5ea531b46f980661ecbae69c93b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:43.815085 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:43.868152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031a648-32ea-4c64-badd-5ef7b48e3e93 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:43.871705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403cf3d-f56d-4489-94df-5e377a1a7371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:43.872309 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403cf3d-f56d-4489-94df-5e377a1a7371 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:43.875523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403cf3d-f56d-4489-94df-5e377a1a7371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:43.875523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403cf3d-f56d-4489-94df-5e377a1a7371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:43.882527 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403cf3d-f56d-4489-94df-5e377a1a7371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:43.883939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403cf3d-f56d-4489-94df-5e377a1a7371 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:43.894191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1364/2750] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:43.994255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:43.996741 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981ff5ea531b46f980661ecbae69c93b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:43.997456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981ff5ea531b46f980661ecbae69c93b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:44.004150 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981ff5ea531b46f980661ecbae69c93b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:44.004833 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981ff5ea531b46f980661ecbae69c93b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:44.016490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981ff5ea531b46f980661ecbae69c93b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:44.169174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1387/2751] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:43 2022] DELETE /identity/v3/users/981ff5ea531b46f980661ecbae69c93b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:44.172057 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f1613-fbb7-4725-8444-2d429e3900e1 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:44.172393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f1613-fbb7-4725-8444-2d429e3900e1 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:44.172679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f1613-fbb7-4725-8444-2d429e3900e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:44.192050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2e4f1613-fbb7-4725-8444-2d429e3900e1 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:44.193291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2e4f1613-fbb7-4725-8444-2d429e3900e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:44.213391 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:44.254725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1365/2752] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:44.265890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:44.267333 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:44.328612 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249721b3-aee2-4042-9ac5-6261185192ac admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:44.332352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d97e0-9f92-43cf-93a5-92da23406fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:44.332994 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d97e0-9f92-43cf-93a5-92da23406fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:44.333301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d97e0-9f92-43cf-93a5-92da23406fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:44.333588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d97e0-9f92-43cf-93a5-92da23406fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:44.342947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d97e0-9f92-43cf-93a5-92da23406fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:44.344607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d97e0-9f92-43cf-93a5-92da23406fbc service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:44.354440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1388/2753] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:44.406690 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f1613-fbb7-4725-8444-2d429e3900e1 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:44.408431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2e4f1613-fbb7-4725-8444-2d429e3900e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:44.421998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f1613-fbb7-4725-8444-2d429e3900e1 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:44.426615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:44.427281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:44.427624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:44.427955 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] PATH_INFO: `/v3/projects/b5127edeead64044a25c3ff9d4c27994` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:44.429078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5127edeead64044a25c3ff9d4c27994)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:44.430968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:44.560316 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5127edeead64044a25c3ff9d4c27994', 'request_id': 'req-b179faae-cc37-4a66-837c-0365fb7e4778'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:44.565837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5127edeead64044a25c3ff9d4c27994', 'request_id': 'req-b179faae-cc37-4a66-837c-0365fb7e4778'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:44.656512 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5127edeead64044a25c3ff9d4c27994', 'request_id': 'req-b179faae-cc37-4a66-837c-0365fb7e4778'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:44.670800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] The token cache is being invalidate because project b5127edeead64044a25c3ff9d4c27994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:44.671151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:44.671799 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-b179faae-cc37-4a66-837c-0365fb7e4778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:44.673643 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1366/2754] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:44 2022] DELETE /identity/v3/projects/b5127edeead64044a25c3ff9d4c27994 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:44.679055 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685a0dd-cf92-41c1-9051-a3e1929018dc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:44.679601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685a0dd-cf92-41c1-9051-a3e1929018dc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:44.679601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685a0dd-cf92-41c1-9051-a3e1929018dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:44.701656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8685a0dd-cf92-41c1-9051-a3e1929018dc None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:44.702974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8685a0dd-cf92-41c1-9051-a3e1929018dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:44.785400 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1389/2755] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:44.794884 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ead34-b84f-46fb-9ec2-f20e4f9f5b91 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:44.795433 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ead34-b84f-46fb-9ec2-f20e4f9f5b91 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:44.795533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ead34-b84f-46fb-9ec2-f20e4f9f5b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:44.816953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-e48ead34-b84f-46fb-9ec2-f20e4f9f5b91 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:44.818104 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e48ead34-b84f-46fb-9ec2-f20e4f9f5b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:44.826469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1367/2756] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:44.832469 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685a0dd-cf92-41c1-9051-a3e1929018dc None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:44.842461 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685a0dd-cf92-41c1-9051-a3e1929018dc None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:44.848645 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27409e6-eacb-4730-9ac4-5325646c4627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:44.849560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27409e6-eacb-4730-9ac4-5325646c4627 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:44.850425 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27409e6-eacb-4730-9ac4-5325646c4627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:44.850680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27409e6-eacb-4730-9ac4-5325646c4627 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:44.851855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27409e6-eacb-4730-9ac4-5325646c4627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:44.851855 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27409e6-eacb-4730-9ac4-5325646c4627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:44.856843 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27409e6-eacb-4730-9ac4-5325646c4627 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:44.867100 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1390/2757] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:16:44.871622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ead34-b84f-46fb-9ec2-f20e4f9f5b91 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:44.881733 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ead34-b84f-46fb-9ec2-f20e4f9f5b91 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:44.886919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb43c-4a28-4f4a-878c-6732ecc66ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:44.887535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb43c-4a28-4f4a-878c-6732ecc66ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:44.887823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb43c-4a28-4f4a-878c-6732ecc66ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:44.888099 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb43c-4a28-4f4a-878c-6732ecc66ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:44.888775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bb43c-4a28-4f4a-878c-6732ecc66ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:44.891181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bb43c-4a28-4f4a-878c-6732ecc66ecc admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:45.022046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1368/2758] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:44 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:45.026209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27409e6-eacb-4730-9ac4-5325646c4627 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:45.036541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27409e6-eacb-4730-9ac4-5325646c4627 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:45.083149 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:45.093366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa49e38-8af7-4dd9-bd77-80ca691a399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:45.094250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa49e38-8af7-4dd9-bd77-80ca691a399e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:45.094531 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa49e38-8af7-4dd9-bd77-80ca691a399e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:45.094825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa49e38-8af7-4dd9-bd77-80ca691a399e admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:45.095498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa49e38-8af7-4dd9-bd77-80ca691a399e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:45.097439 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa49e38-8af7-4dd9-bd77-80ca691a399e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:45.149462 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb43c-4a28-4f4a-878c-6732ecc66ecc admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:45.151268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b30bb43c-4a28-4f4a-878c-6732ecc66ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:45.167862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb43c-4a28-4f4a-878c-6732ecc66ecc admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:45.177020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:45.177805 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:45.178781 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:45.178913 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] PATH_INFO: `/v3/projects/007a2a812e5b4f1e901ec6761c9a00b5` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:45.180203 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=007a2a812e5b4f1e901ec6761c9a00b5)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:45.194755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:45.222272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1391/2759] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:45 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:45.230978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa49e38-8af7-4dd9-bd77-80ca691a399e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:45.235827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa49e38-8af7-4dd9-bd77-80ca691a399e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:45.240926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a76005-2b26-4a34-8885-f1f038ad9204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:45.241513 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a76005-2b26-4a34-8885-f1f038ad9204 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:45.241794 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a76005-2b26-4a34-8885-f1f038ad9204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:45.242067 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a76005-2b26-4a34-8885-f1f038ad9204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:45.242743 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a76005-2b26-4a34-8885-f1f038ad9204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:45.244352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a76005-2b26-4a34-8885-f1f038ad9204 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:45.255077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1392/2760] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:45.259317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a76005-2b26-4a34-8885-f1f038ad9204 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:45.269086 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a76005-2b26-4a34-8885-f1f038ad9204 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:45.273796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cf74d-72e9-4cb9-91ac-0c5de7b45c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:45.274364 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cf74d-72e9-4cb9-91ac-0c5de7b45c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:45.274643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cf74d-72e9-4cb9-91ac-0c5de7b45c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:45.274916 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cf74d-72e9-4cb9-91ac-0c5de7b45c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:45.275607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cf74d-72e9-4cb9-91ac-0c5de7b45c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:45.277203 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cf74d-72e9-4cb9-91ac-0c5de7b45c21 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:45.286676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1393/2761] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:45.290438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cf74d-72e9-4cb9-91ac-0c5de7b45c21 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:45.299777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cf74d-72e9-4cb9-91ac-0c5de7b45c21 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:45.305222 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72529c13-aa7c-4015-9310-e9c7b4d7a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:45.306317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72529c13-aa7c-4015-9310-e9c7b4d7a7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:45.306317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72529c13-aa7c-4015-9310-e9c7b4d7a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:45.306317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72529c13-aa7c-4015-9310-e9c7b4d7a7f7 admin admin] PATH_INFO: `/v3/projects/5efdf384645f4176bbf33869c39b882e/users/20a7a826b1694509970a9811df265eb6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:45.325821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72529c13-aa7c-4015-9310-e9c7b4d7a7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efdf384645f4176bbf33869c39b882e, user_id=20a7a826b1694509970a9811df265eb6, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:45.329275 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72529c13-aa7c-4015-9310-e9c7b4d7a7f7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:45.453860 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1394/2762] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:45 2022] PUT /identity/v3/projects/5efdf384645f4176bbf33869c39b882e/users/20a7a826b1694509970a9811df265eb6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:45.463955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeaa32-a5ae-49a0-b09c-3a5d83fabe8e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:45.464324 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeaa32-a5ae-49a0-b09c-3a5d83fabe8e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:45.464673 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeaa32-a5ae-49a0-b09c-3a5d83fabe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:45.469226 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007a2a812e5b4f1e901ec6761c9a00b5', 'request_id': 'req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:45.478090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007a2a812e5b4f1e901ec6761c9a00b5', 'request_id': 'req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:45.494817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0baeaa32-a5ae-49a0-b09c-3a5d83fabe8e None None] MFA Rules not processed for user `20a7a826b1694509970a9811df265eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:45.496031 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0baeaa32-a5ae-49a0-b09c-3a5d83fabe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:45.559549 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1395/2763] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:45.570700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeaa32-a5ae-49a0-b09c-3a5d83fabe8e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:45.572009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0baeaa32-a5ae-49a0-b09c-3a5d83fabe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:45.587379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007a2a812e5b4f1e901ec6761c9a00b5', 'request_id': 'req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:45.601880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] The token cache is being invalidate because project 007a2a812e5b4f1e901ec6761c9a00b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:45.602213 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:45.602987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:45.604534 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1369/2764] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:45 2022] DELETE /identity/v3/projects/007a2a812e5b4f1e901ec6761c9a00b5 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:45.632752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeaa32-a5ae-49a0-b09c-3a5d83fabe8e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:45.638367 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1805e-9a8a-42c0-bade-310c66825937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:45.639000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1805e-9a8a-42c0-bade-310c66825937 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:45.639277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1805e-9a8a-42c0-bade-310c66825937 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:45.639548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1805e-9a8a-42c0-bade-310c66825937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:45.641481 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-43b1805e-9a8a-42c0-bade-310c66825937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:45.653471 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1805e-9a8a-42c0-bade-310c66825937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:45.654938 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1805e-9a8a-42c0-bade-310c66825937 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:45.666073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1396/2765] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:49.063563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:49.065053 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:49.070658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:49.131942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a79ce0-e2d0-4dff-8eb2-d4d75b9adc12 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:49.136700 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:49.137359 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:49.137656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:49.137937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] PATH_INFO: `/v3/users/20a7a826b1694509970a9811df265eb6` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:49.139094 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a7a826b1694509970a9811df265eb6)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:49.141032 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:49.332421 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a7a826b1694509970a9811df265eb6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:49.333090 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a7a826b1694509970a9811df265eb6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:49.433472 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a7a826b1694509970a9811df265eb6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:49.434050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a7a826b1694509970a9811df265eb6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:49.446595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a7a826b1694509970a9811df265eb6'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:49.458608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1370/2766] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:49 2022] DELETE /identity/v3/users/20a7a826b1694509970a9811df265eb6 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:49.463312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53adb2-3ebb-471c-895d-9d1ce9ea56f0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:49.463789 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53adb2-3ebb-471c-895d-9d1ce9ea56f0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:49.463914 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53adb2-3ebb-471c-895d-9d1ce9ea56f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:49.483049 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1d53adb2-3ebb-471c-895d-9d1ce9ea56f0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:49.484224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1d53adb2-3ebb-471c-895d-9d1ce9ea56f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:49.504207 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:49.543310 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1397/2767] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:49.553160 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:49.554555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:49.611792 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75797158-1483-44cb-8670-9ba6372cf0dc admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:49.615561 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8e8f-d2c2-41cf-aa8c-c7ccf1a4a382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:49.616171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8e8f-d2c2-41cf-aa8c-c7ccf1a4a382 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:49.616469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8e8f-d2c2-41cf-aa8c-c7ccf1a4a382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:49.616746 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8e8f-d2c2-41cf-aa8c-c7ccf1a4a382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:49.625840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a8e8f-d2c2-41cf-aa8c-c7ccf1a4a382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:49.627366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a8e8f-d2c2-41cf-aa8c-c7ccf1a4a382 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:49.636920 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1371/2768] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:50.300144 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53adb2-3ebb-471c-895d-9d1ce9ea56f0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:50.301579 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1d53adb2-3ebb-471c-895d-9d1ce9ea56f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:50.311518 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8e8f-d2c2-41cf-aa8c-c7ccf1a4a382 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:50.313015 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f30a8e8f-d2c2-41cf-aa8c-c7ccf1a4a382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:50.314684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53adb2-3ebb-471c-895d-9d1ce9ea56f0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:50.319722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:50.320322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:50.324935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:50.324935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] PATH_INFO: `/v3/users/fb474c91848c44fc8b604c533593d472` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:50.324935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb474c91848c44fc8b604c533593d472)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:50.324935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:50.370847 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8e8f-d2c2-41cf-aa8c-c7ccf1a4a382 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:50.376881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:50.377531 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:50.377828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:50.378074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] PATH_INFO: `/v3/projects/5efdf384645f4176bbf33869c39b882e` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:50.379224 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efdf384645f4176bbf33869c39b882e)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:50.381172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:50.404169 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:50.580441 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb474c91848c44fc8b604c533593d472'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.581074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efdf384645f4176bbf33869c39b882e', 'request_id': 'req-431c2209-fdf6-4699-952b-dc1a23fc86b9'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.581201 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb474c91848c44fc8b604c533593d472'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.587424 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efdf384645f4176bbf33869c39b882e', 'request_id': 'req-431c2209-fdf6-4699-952b-dc1a23fc86b9'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.589304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb474c91848c44fc8b604c533593d472'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.590183 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb474c91848c44fc8b604c533593d472'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.603415 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4e1d994c-efa2-4f52-8313-420e33a49fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb474c91848c44fc8b604c533593d472'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.650622 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efdf384645f4176bbf33869c39b882e', 'request_id': 'req-431c2209-fdf6-4699-952b-dc1a23fc86b9'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.662041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] The token cache is being invalidate because project 5efdf384645f4176bbf33869c39b882e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:50.662326 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.663594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-431c2209-fdf6-4699-952b-dc1a23fc86b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:50.665141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1372/2769] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:50 2022] DELETE /identity/v3/projects/5efdf384645f4176bbf33869c39b882e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:50.669963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe032-fe2a-44db-a932-050fe16c97b7 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:50.670304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe032-fe2a-44db-a932-050fe16c97b7 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:50.670581 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe032-fe2a-44db-a932-050fe16c97b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:50.689545 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-58dbe032-fe2a-44db-a932-050fe16c97b7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:50.690711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-58dbe032-fe2a-44db-a932-050fe16c97b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:50.747790 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1373/2770] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:50.755280 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1cfd-f441-4a3f-95a8-6a70a516749a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:50.755505 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1cfd-f441-4a3f-95a8-6a70a516749a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:50.755777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1cfd-f441-4a3f-95a8-6a70a516749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:50.769957 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1398/2771] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:50 2022] DELETE /identity/v3/users/fb474c91848c44fc8b604c533593d472 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:50.774682 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc6ad-9ac3-405d-9f77-ff43dcdd4bcf None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:50.774958 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc6ad-9ac3-405d-9f77-ff43dcdd4bcf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:50.775230 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc6ad-9ac3-405d-9f77-ff43dcdd4bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:50.775786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-938f1cfd-f441-4a3f-95a8-6a70a516749a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:50.777028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-938f1cfd-f441-4a3f-95a8-6a70a516749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:50.794104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8bedc6ad-9ac3-405d-9f77-ff43dcdd4bcf None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:50.795306 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8bedc6ad-9ac3-405d-9f77-ff43dcdd4bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:50.840556 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1374/2772] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:50.844474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f1cfd-f441-4a3f-95a8-6a70a516749a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:50.853729 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f1cfd-f441-4a3f-95a8-6a70a516749a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:50.858514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef0421-eb75-4a54-b39c-884f57fea5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:50.859108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef0421-eb75-4a54-b39c-884f57fea5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:50.859473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef0421-eb75-4a54-b39c-884f57fea5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:50.859758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef0421-eb75-4a54-b39c-884f57fea5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:50.860537 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef0421-eb75-4a54-b39c-884f57fea5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:50.860877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef0421-eb75-4a54-b39c-884f57fea5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:50.861083 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1399/2773] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:50.862678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef0421-eb75-4a54-b39c-884f57fea5b2 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:50.871774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedc6ad-9ac3-405d-9f77-ff43dcdd4bcf None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:50.873450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8bedc6ad-9ac3-405d-9f77-ff43dcdd4bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:50.875376 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1375/2774] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:16:50.880029 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef0421-eb75-4a54-b39c-884f57fea5b2 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:50.892076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef0421-eb75-4a54-b39c-884f57fea5b2 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:50.898563 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0e1b5-73e6-47c1-9f59-9c68f87108b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:50.899289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0e1b5-73e6-47c1-9f59-9c68f87108b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:50.899673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0e1b5-73e6-47c1-9f59-9c68f87108b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:50.900049 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0e1b5-73e6-47c1-9f59-9c68f87108b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:50.900971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0e1b5-73e6-47c1-9f59-9c68f87108b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:50.905230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0e1b5-73e6-47c1-9f59-9c68f87108b2 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:50.925635 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:50.939226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedc6ad-9ac3-405d-9f77-ff43dcdd4bcf None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:50.942854 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac0c9d-2f95-4d1d-b31d-955076e26c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:50.943455 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac0c9d-2f95-4d1d-b31d-955076e26c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:50.943731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac0c9d-2f95-4d1d-b31d-955076e26c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:50.944000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac0c9d-2f95-4d1d-b31d-955076e26c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:50.953418 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac0c9d-2f95-4d1d-b31d-955076e26c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:50.954820 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac0c9d-2f95-4d1d-b31d-955076e26c3f service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:50.964998 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1400/2775] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:51.038708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1376/2776] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:50 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:51.039765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac0c9d-2f95-4d1d-b31d-955076e26c3f service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:51.049723 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac0c9d-2f95-4d1d-b31d-955076e26c3f service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:51.107229 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96822a16-fdd9-4603-8ad7-9319c5f07534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:51.107858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96822a16-fdd9-4603-8ad7-9319c5f07534 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.108134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96822a16-fdd9-4603-8ad7-9319c5f07534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.108406 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96822a16-fdd9-4603-8ad7-9319c5f07534 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.109127 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96822a16-fdd9-4603-8ad7-9319c5f07534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:51.111034 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96822a16-fdd9-4603-8ad7-9319c5f07534 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:51.256601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1401/2777] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:51 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:51.261584 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0e1b5-73e6-47c1-9f59-9c68f87108b2 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:51.277697 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0e1b5-73e6-47c1-9f59-9c68f87108b2 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:51.279450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ffb06-9b02-46c6-afb0-03bb8d839d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:51.280173 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ffb06-9b02-46c6-afb0-03bb8d839d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.280453 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ffb06-9b02-46c6-afb0-03bb8d839d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.280725 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ffb06-9b02-46c6-afb0-03bb8d839d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.281463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ffb06-9b02-46c6-afb0-03bb8d839d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:51.283105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ffb06-9b02-46c6-afb0-03bb8d839d1b admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:51.294261 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1377/2778] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:51.298469 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96822a16-fdd9-4603-8ad7-9319c5f07534 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:51.309224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96822a16-fdd9-4603-8ad7-9319c5f07534 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:51.314302 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8bdb0-962e-4eb2-a75d-c3761a6777c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:51.317647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8bdb0-962e-4eb2-a75d-c3761a6777c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.317647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8bdb0-962e-4eb2-a75d-c3761a6777c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.317647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8bdb0-962e-4eb2-a75d-c3761a6777c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.317647 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8bdb0-962e-4eb2-a75d-c3761a6777c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:51.318002 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8bdb0-962e-4eb2-a75d-c3761a6777c2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:51.329016 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1402/2779] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:51.333130 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ffb06-9b02-46c6-afb0-03bb8d839d1b admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:51.338798 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:51.344883 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ffb06-9b02-46c6-afb0-03bb8d839d1b admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:51.349837 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad1a4b-cf85-4e85-88bc-00344baae5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:51.351095 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad1a4b-cf85-4e85-88bc-00344baae5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.351382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad1a4b-cf85-4e85-88bc-00344baae5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.351660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad1a4b-cf85-4e85-88bc-00344baae5e4 admin admin] PATH_INFO: `/v3/projects/e7884b1160924969842011fafe7adad2/users/0d803e12de614aa2a92a33860a4e39af/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.367484 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad1a4b-cf85-4e85-88bc-00344baae5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7884b1160924969842011fafe7adad2, user_id=0d803e12de614aa2a92a33860a4e39af, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:51.370189 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad1a4b-cf85-4e85-88bc-00344baae5e4 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:51.516213 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8bdb0-962e-4eb2-a75d-c3761a6777c2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:51.520352 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b3f8bdb0-962e-4eb2-a75d-c3761a6777c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:51.533292 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1378/2780] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:51 2022] PUT /identity/v3/projects/e7884b1160924969842011fafe7adad2/users/0d803e12de614aa2a92a33860a4e39af/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:51.534422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8bdb0-962e-4eb2-a75d-c3761a6777c2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:51.592665 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028921d-a72f-4c38-afa4-94948c230389 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.593460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028921d-a72f-4c38-afa4-94948c230389 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.593994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028921d-a72f-4c38-afa4-94948c230389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.611910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:51.612555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.612869 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.613175 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] PATH_INFO: `/v3/projects/ffe8d4c3488a48a9b68ed086999783e4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.614639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe8d4c3488a48a9b68ed086999783e4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:51.617480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:51.623296 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-b028921d-a72f-4c38-afa4-94948c230389 None None] MFA Rules not processed for user `0d803e12de614aa2a92a33860a4e39af`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:51.624513 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b028921d-a72f-4c38-afa4-94948c230389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:51.688289 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1379/2781] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:51.699800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028921d-a72f-4c38-afa4-94948c230389 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:51.701185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b028921d-a72f-4c38-afa4-94948c230389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:51.759565 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe8d4c3488a48a9b68ed086999783e4', 'request_id': 'req-9492e17f-0ec3-4520-b843-8e7ba033a2e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.779906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028921d-a72f-4c38-afa4-94948c230389 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:51.829739 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b44c6c-a01c-414c-a645-9241c0bcec00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:51.830270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b44c6c-a01c-414c-a645-9241c0bcec00 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.830577 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b44c6c-a01c-414c-a645-9241c0bcec00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.830849 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b44c6c-a01c-414c-a645-9241c0bcec00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.838926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe8d4c3488a48a9b68ed086999783e4', 'request_id': 'req-9492e17f-0ec3-4520-b843-8e7ba033a2e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.844452 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:51.848456 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe8d4c3488a48a9b68ed086999783e4', 'request_id': 'req-9492e17f-0ec3-4520-b843-8e7ba033a2e4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.857588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] The token cache is being invalidate because project ffe8d4c3488a48a9b68ed086999783e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:51.857872 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.858572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9492e17f-0ec3-4520-b843-8e7ba033a2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:51.860178 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1403/2782] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:51 2022] DELETE /identity/v3/projects/ffe8d4c3488a48a9b68ed086999783e4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:51.864875 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc309971-11a2-4fe9-ac28-f846638e941c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.865164 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc309971-11a2-4fe9-ac28-f846638e941c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.865493 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc309971-11a2-4fe9-ac28-f846638e941c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.888215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fc309971-11a2-4fe9-ac28-f846638e941c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:51.889459 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fc309971-11a2-4fe9-ac28-f846638e941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:51.889718 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b44c6c-a01c-414c-a645-9241c0bcec00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:51.891214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b44c6c-a01c-414c-a645-9241c0bcec00 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:51.901054 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1380/2783] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:51.963578 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1404/2784] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:51.971616 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147292f9-0644-42dd-984b-15f7f56a06b3 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:51.971973 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147292f9-0644-42dd-984b-15f7f56a06b3 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:51.972405 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147292f9-0644-42dd-984b-15f7f56a06b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:51.992608 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-147292f9-0644-42dd-984b-15f7f56a06b3 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:51.993862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-147292f9-0644-42dd-984b-15f7f56a06b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:52.001917 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1381/2785] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:52.006410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc309971-11a2-4fe9-ac28-f846638e941c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:52.016589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc309971-11a2-4fe9-ac28-f846638e941c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:52.021587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4340b7-6bf6-4122-9516-a18b15551e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:52.022220 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4340b7-6bf6-4122-9516-a18b15551e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.022500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4340b7-6bf6-4122-9516-a18b15551e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.022763 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4340b7-6bf6-4122-9516-a18b15551e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.023450 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4340b7-6bf6-4122-9516-a18b15551e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:52.023819 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4340b7-6bf6-4122-9516-a18b15551e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:52.025717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4340b7-6bf6-4122-9516-a18b15551e15 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:52.038056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1405/2786] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:52.042575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147292f9-0644-42dd-984b-15f7f56a06b3 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:52.051990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147292f9-0644-42dd-984b-15f7f56a06b3 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:52.057436 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea44b12-4338-46d2-b75f-dd58bf8ca001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:52.058048 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea44b12-4338-46d2-b75f-dd58bf8ca001 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.058324 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea44b12-4338-46d2-b75f-dd58bf8ca001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.058624 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea44b12-4338-46d2-b75f-dd58bf8ca001 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.059293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea44b12-4338-46d2-b75f-dd58bf8ca001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:52.062736 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea44b12-4338-46d2-b75f-dd58bf8ca001 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:52.202471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1382/2787] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:52 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:52.209064 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4340b7-6bf6-4122-9516-a18b15551e15 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:52.216983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4340b7-6bf6-4122-9516-a18b15551e15 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:52.273401 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2222ae0-99c0-4163-a1c9-b790f1698cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:52.274013 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2222ae0-99c0-4163-a1c9-b790f1698cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.274293 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2222ae0-99c0-4163-a1c9-b790f1698cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.274568 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2222ae0-99c0-4163-a1c9-b790f1698cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.275237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2222ae0-99c0-4163-a1c9-b790f1698cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:52.277239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2222ae0-99c0-4163-a1c9-b790f1698cc0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:52.393692 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1406/2788] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:52 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:52.398474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea44b12-4338-46d2-b75f-dd58bf8ca001 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:52.409272 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea44b12-4338-46d2-b75f-dd58bf8ca001 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:52.414016 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48b3f5-a9fa-482d-ad67-91c335b424c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:52.414592 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48b3f5-a9fa-482d-ad67-91c335b424c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.414870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48b3f5-a9fa-482d-ad67-91c335b424c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.415142 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48b3f5-a9fa-482d-ad67-91c335b424c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.415836 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48b3f5-a9fa-482d-ad67-91c335b424c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:52.417483 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48b3f5-a9fa-482d-ad67-91c335b424c0 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:52.427240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1383/2789] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:52.431247 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2222ae0-99c0-4163-a1c9-b790f1698cc0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:52.441356 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2222ae0-99c0-4163-a1c9-b790f1698cc0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:52.447056 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ad176-30ce-497b-9fdd-45bebdd7ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:52.447670 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ad176-30ce-497b-9fdd-45bebdd7ab69 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.456121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ad176-30ce-497b-9fdd-45bebdd7ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.456121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ad176-30ce-497b-9fdd-45bebdd7ab69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.456121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ad176-30ce-497b-9fdd-45bebdd7ab69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:52.456121 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ad176-30ce-497b-9fdd-45bebdd7ab69 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:52.462250 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1407/2790] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:52.466320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48b3f5-a9fa-482d-ad67-91c335b424c0 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:52.476315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48b3f5-a9fa-482d-ad67-91c335b424c0 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:52.481237 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a8e96-90ff-40ef-971f-d0d20cceaade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:52.481924 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a8e96-90ff-40ef-971f-d0d20cceaade admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.482206 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a8e96-90ff-40ef-971f-d0d20cceaade admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.482480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a8e96-90ff-40ef-971f-d0d20cceaade admin admin] PATH_INFO: `/v3/projects/284f0dfd7611428cabbde550355e3df3/users/151b0ee32412482a8884567558b58e92/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.497336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a8e96-90ff-40ef-971f-d0d20cceaade admin admin] RBAC: Authorizing `identity:create_grant(project_id=284f0dfd7611428cabbde550355e3df3, user_id=151b0ee32412482a8884567558b58e92, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:52.500068 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a8e96-90ff-40ef-971f-d0d20cceaade admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:52.588257 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1384/2791] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:52 2022] PUT /identity/v3/projects/284f0dfd7611428cabbde550355e3df3/users/151b0ee32412482a8884567558b58e92/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:52.600036 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d940e-1805-45d4-a572-eeacf9c2d7ad None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.600321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d940e-1805-45d4-a572-eeacf9c2d7ad None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.600601 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d940e-1805-45d4-a572-eeacf9c2d7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.628066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-147d940e-1805-45d4-a572-eeacf9c2d7ad None None] MFA Rules not processed for user `151b0ee32412482a8884567558b58e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:52.629309 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-147d940e-1805-45d4-a572-eeacf9c2d7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:52.693690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1408/2792] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:52.708204 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a8e96-90ff-40ef-971f-d0d20cceaade admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:52.710121 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8c2a8e96-90ff-40ef-971f-d0d20cceaade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:52.754481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:52.770079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a8e96-90ff-40ef-971f-d0d20cceaade admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:52.774333 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043cb58-f054-48c8-932c-3e0ab79542ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:52.774942 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043cb58-f054-48c8-932c-3e0ab79542ed service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:52.775224 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043cb58-f054-48c8-932c-3e0ab79542ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:52.775498 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043cb58-f054-48c8-932c-3e0ab79542ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:52.783875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043cb58-f054-48c8-932c-3e0ab79542ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:52.785373 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043cb58-f054-48c8-932c-3e0ab79542ed service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:52.794939 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1385/2793] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:53.582332 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:55.673718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d940e-1805-45d4-a572-eeacf9c2d7ad None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:55.675315 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-147d940e-1805-45d4-a572-eeacf9c2d7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:55.743969 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d940e-1805-45d4-a572-eeacf9c2d7ad None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:55.748522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:55.749187 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:55.749467 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:55.749737 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] PATH_INFO: `/v3/users/f115b86f662e42c1b56f611d770716be` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:55.750902 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f115b86f662e42c1b56f611d770716be)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:55.752810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:55.995935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f115b86f662e42c1b56f611d770716be'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:55.996592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f115b86f662e42c1b56f611d770716be'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:56.003376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f115b86f662e42c1b56f611d770716be'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:56.003999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f115b86f662e42c1b56f611d770716be'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:56.017560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f115b86f662e42c1b56f611d770716be'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:56.119312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1409/2794] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:55 2022] DELETE /identity/v3/users/f115b86f662e42c1b56f611d770716be => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:56.123662 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724be7-7cf5-4b13-9764-07d1ec4d0d9f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:56.124139 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724be7-7cf5-4b13-9764-07d1ec4d0d9f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:56.124240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724be7-7cf5-4b13-9764-07d1ec4d0d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:56.143125 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-2f724be7-7cf5-4b13-9764-07d1ec4d0d9f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:56.144314 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2f724be7-7cf5-4b13-9764-07d1ec4d0d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:56.195465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:56.204679 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1386/2795] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:56.214498 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:56.215947 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:56.276523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d894331-c38a-4bfa-a042-e21c050db0b7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:56.281572 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0618386-0652-4141-a84a-f3b444e31f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:56.281870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618386-0652-4141-a84a-f3b444e31f73 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:56.282051 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618386-0652-4141-a84a-f3b444e31f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:56.282298 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0618386-0652-4141-a84a-f3b444e31f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:56.293472 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0618386-0652-4141-a84a-f3b444e31f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:56.294941 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0618386-0652-4141-a84a-f3b444e31f73 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:56.304631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1410/2796] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:56.755137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724be7-7cf5-4b13-9764-07d1ec4d0d9f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:56.760490 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-2f724be7-7cf5-4b13-9764-07d1ec4d0d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:56.769762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724be7-7cf5-4b13-9764-07d1ec4d0d9f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:56.776019 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:56.777774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:56.777774 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:56.777981 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] PATH_INFO: `/v3/projects/fb7d7b366f38409c87fca73e874c2968` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:56.782221 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7d7b366f38409c87fca73e874c2968)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:56.784137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:56.890949 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7d7b366f38409c87fca73e874c2968', 'request_id': 'req-c7929aa2-9563-452a-ac61-f622df8850fc'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:56.896813 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7d7b366f38409c87fca73e874c2968', 'request_id': 'req-c7929aa2-9563-452a-ac61-f622df8850fc'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:57.005149 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7d7b366f38409c87fca73e874c2968', 'request_id': 'req-c7929aa2-9563-452a-ac61-f622df8850fc'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:57.017119 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] The token cache is being invalidate because project fb7d7b366f38409c87fca73e874c2968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:57.017406 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:57.018039 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-c7929aa2-9563-452a-ac61-f622df8850fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:57.019590 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1387/2797] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:56 2022] DELETE /identity/v3/projects/fb7d7b366f38409c87fca73e874c2968 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:57.025503 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccd4f1-9745-472d-89e7-242cc488d8e7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.025973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccd4f1-9745-472d-89e7-242cc488d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.026101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccd4f1-9745-472d-89e7-242cc488d8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.045636 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-11ccd4f1-9745-472d-89e7-242cc488d8e7 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:57.046852 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-11ccd4f1-9745-472d-89e7-242cc488d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:57.051038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:57.105264 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1411/2798] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:57.113773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0f0af-6e97-4714-bc3e-36266122b565 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.114129 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0f0af-6e97-4714-bc3e-36266122b565 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.114465 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0f0af-6e97-4714-bc3e-36266122b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.133997 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-e0e0f0af-6e97-4714-bc3e-36266122b565 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:57.135183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e0e0f0af-6e97-4714-bc3e-36266122b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:57.142882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1388/2799] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:57.149629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccd4f1-9745-472d-89e7-242cc488d8e7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:57.159385 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccd4f1-9745-472d-89e7-242cc488d8e7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:57.164643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec30280-b781-4f00-aa65-bad8801d0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:57.165726 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30280-b781-4f00-aa65-bad8801d0a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.166012 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30280-b781-4f00-aa65-bad8801d0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.166291 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30280-b781-4f00-aa65-bad8801d0a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.166975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec30280-b781-4f00-aa65-bad8801d0a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:57.171906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec30280-b781-4f00-aa65-bad8801d0a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:57.171906 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec30280-b781-4f00-aa65-bad8801d0a69 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:57.181482 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1412/2800] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:16:57.185867 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0f0af-6e97-4714-bc3e-36266122b565 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:57.195230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0f0af-6e97-4714-bc3e-36266122b565 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:57.199984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c58f3-aee6-4978-9038-5baf726e5107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:57.200585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c58f3-aee6-4978-9038-5baf726e5107 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.200908 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c58f3-aee6-4978-9038-5baf726e5107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.201214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c58f3-aee6-4978-9038-5baf726e5107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.201875 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c58f3-aee6-4978-9038-5baf726e5107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:57.203797 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c58f3-aee6-4978-9038-5baf726e5107 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:57.325564 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1389/2801] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:57 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:57.326678 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec30280-b781-4f00-aa65-bad8801d0a69 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:57.337519 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec30280-b781-4f00-aa65-bad8801d0a69 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:57.337708 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c58f3-aee6-4978-9038-5baf726e5107 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:57.339304 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-663c58f3-aee6-4978-9038-5baf726e5107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:57.408444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddadbd3-954b-4e42-b39e-32ba3a99dd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:57.409000 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddadbd3-954b-4e42-b39e-32ba3a99dd74 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.409285 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddadbd3-954b-4e42-b39e-32ba3a99dd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.409809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddadbd3-954b-4e42-b39e-32ba3a99dd74 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.410242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddadbd3-954b-4e42-b39e-32ba3a99dd74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:57.412888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddadbd3-954b-4e42-b39e-32ba3a99dd74 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:57.427035 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c58f3-aee6-4978-9038-5baf726e5107 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:57.431844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:57.432491 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.432775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.433079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] PATH_INFO: `/v3/users/151b0ee32412482a8884567558b58e92` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.434297 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151b0ee32412482a8884567558b58e92)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:57.436215 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:57.508509 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1413/2802] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:57 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:57.512515 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddadbd3-954b-4e42-b39e-32ba3a99dd74 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:57.522117 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddadbd3-954b-4e42-b39e-32ba3a99dd74 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:57.527373 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892cb23-ee54-4eaa-86b4-627247cb4332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:57.527974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892cb23-ee54-4eaa-86b4-627247cb4332 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.528259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892cb23-ee54-4eaa-86b4-627247cb4332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.528538 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892cb23-ee54-4eaa-86b4-627247cb4332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.529270 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892cb23-ee54-4eaa-86b4-627247cb4332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:57.531690 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892cb23-ee54-4eaa-86b4-627247cb4332 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:57.543620 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1414/2803] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:57.552090 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892cb23-ee54-4eaa-86b4-627247cb4332 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:57.561928 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892cb23-ee54-4eaa-86b4-627247cb4332 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:57.566436 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992aafb-9012-47d4-8d9f-c1cf4ace44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:57.567009 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992aafb-9012-47d4-8d9f-c1cf4ace44aa admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.567288 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992aafb-9012-47d4-8d9f-c1cf4ace44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.567558 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992aafb-9012-47d4-8d9f-c1cf4ace44aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.568227 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992aafb-9012-47d4-8d9f-c1cf4ace44aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:57.570378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992aafb-9012-47d4-8d9f-c1cf4ace44aa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:57.580004 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1415/2804] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:57.590317 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992aafb-9012-47d4-8d9f-c1cf4ace44aa admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:57.599784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992aafb-9012-47d4-8d9f-c1cf4ace44aa admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:57.604540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93c9f5-ac1a-4eab-ab2e-58f38ab8f4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:57.605217 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c9f5-ac1a-4eab-ab2e-58f38ab8f4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.605494 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c9f5-ac1a-4eab-ab2e-58f38ab8f4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.605798 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c9f5-ac1a-4eab-ab2e-58f38ab8f4fc admin admin] PATH_INFO: `/v3/projects/d319242128ef47b6b4aa0395c79f3260/users/630e281a1030423a962ae4e936365dec/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.625039 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93c9f5-ac1a-4eab-ab2e-58f38ab8f4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d319242128ef47b6b4aa0395c79f3260, user_id=630e281a1030423a962ae4e936365dec, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:57.627703 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93c9f5-ac1a-4eab-ab2e-58f38ab8f4fc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:57.653233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151b0ee32412482a8884567558b58e92'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:57.653934 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151b0ee32412482a8884567558b58e92'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:57.718077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1416/2805] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:57 2022] PUT /identity/v3/projects/d319242128ef47b6b4aa0395c79f3260/users/630e281a1030423a962ae4e936365dec/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:57.728299 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dd27a-303c-4b69-a215-fea646702cba None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.728606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dd27a-303c-4b69-a215-fea646702cba None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.728913 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dd27a-303c-4b69-a215-fea646702cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.736182 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151b0ee32412482a8884567558b58e92'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:57.737460 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151b0ee32412482a8884567558b58e92'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:57.739052 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:57.751404 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-551d1b90-8ee3-4484-8437-43a4c8e6e785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151b0ee32412482a8884567558b58e92'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:57.756290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-382dd27a-303c-4b69-a215-fea646702cba None None] MFA Rules not processed for user `630e281a1030423a962ae4e936365dec`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:57.758117 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-382dd27a-303c-4b69-a215-fea646702cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:57.764442 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1390/2806] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:16:57 2022] DELETE /identity/v3/users/151b0ee32412482a8884567558b58e92 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:57.768706 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4c28-e93f-48c9-9bf2-6959f828a58f None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.769025 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4c28-e93f-48c9-9bf2-6959f828a58f None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.771482 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4c28-e93f-48c9-9bf2-6959f828a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.787848 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:57.788705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-29df4c28-e93f-48c9-9bf2-6959f828a58f None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:57.789209 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-29df4c28-e93f-48c9-9bf2-6959f828a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:57.824237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1417/2807] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:57.828733 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dd27a-303c-4b69-a215-fea646702cba None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:57.831369 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-382dd27a-303c-4b69-a215-fea646702cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:57.856105 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1391/2808] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:57.867322 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df4c28-e93f-48c9-9bf2-6959f828a58f None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:57.868776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-29df4c28-e93f-48c9-9bf2-6959f828a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:57.899141 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dd27a-303c-4b69-a215-fea646702cba None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:57.903839 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951819-937d-4765-90f3-53d54893b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:57.904491 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951819-937d-4765-90f3-53d54893b38b admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.904774 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951819-937d-4765-90f3-53d54893b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.905079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951819-937d-4765-90f3-53d54893b38b admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.905746 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f951819-937d-4765-90f3-53d54893b38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:57.907718 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f951819-937d-4765-90f3-53d54893b38b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:57.930760 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df4c28-e93f-48c9-9bf2-6959f828a58f None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:57.934458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102855f-4f71-4018-b284-7c566f342385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:57.942604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102855f-4f71-4018-b284-7c566f342385 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:57.942604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102855f-4f71-4018-b284-7c566f342385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:57.942604 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102855f-4f71-4018-b284-7c566f342385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:57.945273 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102855f-4f71-4018-b284-7c566f342385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:57.946712 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102855f-4f71-4018-b284-7c566f342385 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:57.955910 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1392/2809] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:16:58.043643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1418/2810] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:57 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:58.045338 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102855f-4f71-4018-b284-7c566f342385 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.055637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102855f-4f71-4018-b284-7c566f342385 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.114263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795358-ae56-4f4f-97c6-a903b6066684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.114887 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795358-ae56-4f4f-97c6-a903b6066684 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.115175 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795358-ae56-4f4f-97c6-a903b6066684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.115452 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795358-ae56-4f4f-97c6-a903b6066684 admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.116663 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4795358-ae56-4f4f-97c6-a903b6066684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.118710 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4795358-ae56-4f4f-97c6-a903b6066684 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:58.229233 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1393/2811] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:58 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:58.233325 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951819-937d-4765-90f3-53d54893b38b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.244643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951819-937d-4765-90f3-53d54893b38b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.249570 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d9fe0-73e5-4597-b417-7adad299d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.251911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d9fe0-73e5-4597-b417-7adad299d835 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.251911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d9fe0-73e5-4597-b417-7adad299d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.251911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d9fe0-73e5-4597-b417-7adad299d835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.251911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d9fe0-73e5-4597-b417-7adad299d835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.253381 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d9fe0-73e5-4597-b417-7adad299d835 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:58.264955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1419/2812] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:58.268848 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795358-ae56-4f4f-97c6-a903b6066684 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.275399 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:58.279568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795358-ae56-4f4f-97c6-a903b6066684 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.284629 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36c652-29db-4788-921d-036fd93344b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.285348 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36c652-29db-4788-921d-036fd93344b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.285569 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36c652-29db-4788-921d-036fd93344b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.285840 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36c652-29db-4788-921d-036fd93344b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.286533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36c652-29db-4788-921d-036fd93344b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.288711 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36c652-29db-4788-921d-036fd93344b9 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:58.299126 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1394/2813] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:58.303257 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d9fe0-73e5-4597-b417-7adad299d835 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.314126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d9fe0-73e5-4597-b417-7adad299d835 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.318893 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d92d-cc65-4f7e-a316-0ace5f963541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.320380 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d92d-cc65-4f7e-a316-0ace5f963541 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.320500 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d92d-cc65-4f7e-a316-0ace5f963541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.320672 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d92d-cc65-4f7e-a316-0ace5f963541 admin admin] PATH_INFO: `/v3/projects/03e8b44a23bc4db88ee37f82ff8beb02/users/92822e198a5f461281c7a75cd18a928f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.338021 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545d92d-cc65-4f7e-a316-0ace5f963541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e8b44a23bc4db88ee37f82ff8beb02, user_id=92822e198a5f461281c7a75cd18a928f, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.340714 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545d92d-cc65-4f7e-a316-0ace5f963541 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:58.483587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1420/2814] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:58 2022] PUT /identity/v3/projects/03e8b44a23bc4db88ee37f82ff8beb02/users/92822e198a5f461281c7a75cd18a928f/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:58.483947 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36c652-29db-4788-921d-036fd93344b9 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.484046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9982c5-ee79-406b-bb60-6d5128747578 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.484046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9982c5-ee79-406b-bb60-6d5128747578 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.484046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9982c5-ee79-406b-bb60-6d5128747578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.484293 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-bc36c652-29db-4788-921d-036fd93344b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:58.502150 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36c652-29db-4788-921d-036fd93344b9 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.518582 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bd9982c5-ee79-406b-bb60-6d5128747578 None None] MFA Rules not processed for user `92822e198a5f461281c7a75cd18a928f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:58.519834 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bd9982c5-ee79-406b-bb60-6d5128747578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:58.570085 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.575199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.575199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.575199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] PATH_INFO: `/v3/projects/284f0dfd7611428cabbde550355e3df3` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.575199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=284f0dfd7611428cabbde550355e3df3)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.575199 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:58.588070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1421/2815] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:58.592607 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9982c5-ee79-406b-bb60-6d5128747578 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.606600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9982c5-ee79-406b-bb60-6d5128747578 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.611717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0cfa-c56e-4f95-b904-97c5df91f03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.612339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0cfa-c56e-4f95-b904-97c5df91f03d admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.615540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0cfa-c56e-4f95-b904-97c5df91f03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.615540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0cfa-c56e-4f95-b904-97c5df91f03d admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.615540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea0cfa-c56e-4f95-b904-97c5df91f03d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.615540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea0cfa-c56e-4f95-b904-97c5df91f03d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:58.624571 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:58.682086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284f0dfd7611428cabbde550355e3df3', 'request_id': 'req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:58.694986 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284f0dfd7611428cabbde550355e3df3', 'request_id': 'req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:58.770521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284f0dfd7611428cabbde550355e3df3', 'request_id': 'req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:58.778788 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1422/2816] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:58 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:58.782304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0cfa-c56e-4f95-b904-97c5df91f03d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.785819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] The token cache is being invalidate because project 284f0dfd7611428cabbde550355e3df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:16:58.786171 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:58.786950 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-d6f0efa9-c077-48f3-bf27-52b0f9f77e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:16:58.788982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1395/2817] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:16:58 2022] DELETE /identity/v3/projects/284f0dfd7611428cabbde550355e3df3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:58.793933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe492b-57a3-4861-b6ed-7a031bbc9946 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.794205 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe492b-57a3-4861-b6ed-7a031bbc9946 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.794553 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe492b-57a3-4861-b6ed-7a031bbc9946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.816158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-1bfe492b-57a3-4861-b6ed-7a031bbc9946 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:58.817456 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1bfe492b-57a3-4861-b6ed-7a031bbc9946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:58.848126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0cfa-c56e-4f95-b904-97c5df91f03d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.858695 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61625821-88eb-465f-8737-b7f8071b8c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.859330 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625821-88eb-465f-8737-b7f8071b8c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.859609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625821-88eb-465f-8737-b7f8071b8c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.859882 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625821-88eb-465f-8737-b7f8071b8c07 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.860555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61625821-88eb-465f-8737-b7f8071b8c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.862508 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61625821-88eb-465f-8737-b7f8071b8c07 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:58.882514 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1396/2818] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:58.890103 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a29e1-dc44-4623-88ed-3dd769c3d3ee None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.890401 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a29e1-dc44-4623-88ed-3dd769c3d3ee None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.890681 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a29e1-dc44-4623-88ed-3dd769c3d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.910240 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-1e8a29e1-dc44-4623-88ed-3dd769c3d3ee None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:58.911450 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1e8a29e1-dc44-4623-88ed-3dd769c3d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:58.919982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1397/2819] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:58.924086 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a29e1-dc44-4623-88ed-3dd769c3d3ee None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.934059 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a29e1-dc44-4623-88ed-3dd769c3d3ee None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.938741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283afab-f9ee-451b-925c-ec9c192a5048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.939340 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283afab-f9ee-451b-925c-ec9c192a5048 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.939645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283afab-f9ee-451b-925c-ec9c192a5048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.939907 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283afab-f9ee-451b-925c-ec9c192a5048 admin admin] PATH_INFO: `/v3/domains` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.940595 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283afab-f9ee-451b-925c-ec9c192a5048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:16:58.940933 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283afab-f9ee-451b-925c-ec9c192a5048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.942568 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283afab-f9ee-451b-925c-ec9c192a5048 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:58.968274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1398/2820] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:16:58.971689 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283afab-f9ee-451b-925c-ec9c192a5048 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:58.978680 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:58.982207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283afab-f9ee-451b-925c-ec9c192a5048 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:58.987037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06755d-9c03-4221-a2f3-89d88c196309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:58.987826 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06755d-9c03-4221-a2f3-89d88c196309 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:58.988108 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06755d-9c03-4221-a2f3-89d88c196309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:58.988379 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06755d-9c03-4221-a2f3-89d88c196309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:58.989093 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06755d-9c03-4221-a2f3-89d88c196309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:58.990958 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06755d-9c03-4221-a2f3-89d88c196309 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.033754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1423/2821] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:58 2022] POST /identity/v3/users => generated 299 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:59.037413 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61625821-88eb-465f-8737-b7f8071b8c07 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.039656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-61625821-88eb-465f-8737-b7f8071b8c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:59.121873 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61625821-88eb-465f-8737-b7f8071b8c07 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.127106 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcae42-3f95-4fb9-9047-8bbab76e115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.127722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcae42-3f95-4fb9-9047-8bbab76e115f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.128001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcae42-3f95-4fb9-9047-8bbab76e115f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.128273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcae42-3f95-4fb9-9047-8bbab76e115f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.129024 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcae42-3f95-4fb9-9047-8bbab76e115f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.130609 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcae42-3f95-4fb9-9047-8bbab76e115f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.140687 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1424/2822] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:59.144748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcae42-3f95-4fb9-9047-8bbab76e115f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.158344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcae42-3f95-4fb9-9047-8bbab76e115f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.160015 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a676406-5108-4b71-b1a6-5dc8d56aea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.160758 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1399/2823] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:16:58 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:16:59.160983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676406-5108-4b71-b1a6-5dc8d56aea8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.167522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676406-5108-4b71-b1a6-5dc8d56aea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.167522 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676406-5108-4b71-b1a6-5dc8d56aea8a admin admin] PATH_INFO: `/v3/projects/46914dde4bf8411f8cd3028ff5dae92c/users/b0eff02456c445e7b575e60180eb2a94/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.170566 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06755d-9c03-4221-a2f3-89d88c196309 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.184424 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a676406-5108-4b71-b1a6-5dc8d56aea8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46914dde4bf8411f8cd3028ff5dae92c, user_id=b0eff02456c445e7b575e60180eb2a94, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.187561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a676406-5108-4b71-b1a6-5dc8d56aea8a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.235242 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06755d-9c03-4221-a2f3-89d88c196309 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.240419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188db9-3a25-4557-8c1a-a25d6f7dcabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.240615 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188db9-3a25-4557-8c1a-a25d6f7dcabe admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.240926 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188db9-3a25-4557-8c1a-a25d6f7dcabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.241195 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188db9-3a25-4557-8c1a-a25d6f7dcabe admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.241846 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06188db9-3a25-4557-8c1a-a25d6f7dcabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.243901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06188db9-3a25-4557-8c1a-a25d6f7dcabe admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.284674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1425/2824] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:59 2022] PUT /identity/v3/projects/46914dde4bf8411f8cd3028ff5dae92c/users/b0eff02456c445e7b575e60180eb2a94/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:16:59.288376 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a676406-5108-4b71-b1a6-5dc8d56aea8a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.353593 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a676406-5108-4b71-b1a6-5dc8d56aea8a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.358657 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cb21d-88b5-4776-b33b-de1679bef705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.367495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb21d-88b5-4776-b33b-de1679bef705 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.367495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb21d-88b5-4776-b33b-de1679bef705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.367495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb21d-88b5-4776-b33b-de1679bef705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.367495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cb21d-88b5-4776-b33b-de1679bef705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.367495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cb21d-88b5-4776-b33b-de1679bef705 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.372485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1426/2825] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:59.376512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cb21d-88b5-4776-b33b-de1679bef705 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.386177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cb21d-88b5-4776-b33b-de1679bef705 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.392693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3237c7d-54f7-4f0a-ab5e-1e32b12501a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.392693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237c7d-54f7-4f0a-ab5e-1e32b12501a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.392693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237c7d-54f7-4f0a-ab5e-1e32b12501a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.392693 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237c7d-54f7-4f0a-ab5e-1e32b12501a5 admin admin] PATH_INFO: `/v3/projects/46914dde4bf8411f8cd3028ff5dae92c/users/b0eff02456c445e7b575e60180eb2a94/roles/2c1f5ec1d39b411ab14cef7d19d674b5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.394169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237c7d-54f7-4f0a-ab5e-1e32b12501a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46914dde4bf8411f8cd3028ff5dae92c, user_id=b0eff02456c445e7b575e60180eb2a94, role_id=2c1f5ec1d39b411ab14cef7d19d674b5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.396775 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237c7d-54f7-4f0a-ab5e-1e32b12501a5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.407020 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1400/2826] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:16:59 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:16:59.409745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1427/2827] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:59 2022] PUT /identity/v3/projects/46914dde4bf8411f8cd3028ff5dae92c/users/b0eff02456c445e7b575e60180eb2a94/roles/2c1f5ec1d39b411ab14cef7d19d674b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:59.410728 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188db9-3a25-4557-8c1a-a25d6f7dcabe admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.427936 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188db9-3a25-4557-8c1a-a25d6f7dcabe admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.480842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512119c-9fc7-45ad-928d-cb5ec83aeb70 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.481136 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512119c-9fc7-45ad-928d-cb5ec83aeb70 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.481412 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512119c-9fc7-45ad-928d-cb5ec83aeb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.505582 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23235081-067a-4125-a449-1fa0ee45a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.506281 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235081-067a-4125-a449-1fa0ee45a842 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.506585 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235081-067a-4125-a449-1fa0ee45a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.506857 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235081-067a-4125-a449-1fa0ee45a842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.507642 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23235081-067a-4125-a449-1fa0ee45a842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.509268 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23235081-067a-4125-a449-1fa0ee45a842 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.511377 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a512119c-9fc7-45ad-928d-cb5ec83aeb70 None None] MFA Rules not processed for user `b0eff02456c445e7b575e60180eb2a94`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:59.512589 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a512119c-9fc7-45ad-928d-cb5ec83aeb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:59.519833 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1401/2828] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:16:59.525919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23235081-067a-4125-a449-1fa0ee45a842 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.526923 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:59.535644 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23235081-067a-4125-a449-1fa0ee45a842 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.540974 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0d61-279a-4e22-a455-7989637f1b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.541578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0d61-279a-4e22-a455-7989637f1b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.541854 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0d61-279a-4e22-a455-7989637f1b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.542124 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0d61-279a-4e22-a455-7989637f1b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.542808 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0d61-279a-4e22-a455-7989637f1b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.544382 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0d61-279a-4e22-a455-7989637f1b70 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.555668 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1402/2829] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:16:59.559828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0d61-279a-4e22-a455-7989637f1b70 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.569477 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0d61-279a-4e22-a455-7989637f1b70 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.574787 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f0496-3151-4884-be5c-7300edd2df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.575426 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f0496-3151-4884-be5c-7300edd2df8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.575704 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f0496-3151-4884-be5c-7300edd2df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.575975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f0496-3151-4884-be5c-7300edd2df8c admin admin] PATH_INFO: `/v3/projects/a82d4e9493c24d92a6d7dbb23f4b5387/users/f2c15e3b7f3a42dc848ddd1ccdb9c7a6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.591451 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f0496-3151-4884-be5c-7300edd2df8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82d4e9493c24d92a6d7dbb23f4b5387, user_id=f2c15e3b7f3a42dc848ddd1ccdb9c7a6, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.594539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f0496-3151-4884-be5c-7300edd2df8c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.596838 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1428/2830] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 18:16:59.608809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512119c-9fc7-45ad-928d-cb5ec83aeb70 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.608809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a512119c-9fc7-45ad-928d-cb5ec83aeb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:59.664038 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512119c-9fc7-45ad-928d-cb5ec83aeb70 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.668046 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ade9c-d666-40b3-9976-bed63c63e19f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.668768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ade9c-d666-40b3-9976-bed63c63e19f service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.668988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ade9c-d666-40b3-9976-bed63c63e19f service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.669261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ade9c-d666-40b3-9976-bed63c63e19f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.671092 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ce4ade9c-d666-40b3-9976-bed63c63e19f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:59.730177 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ade9c-d666-40b3-9976-bed63c63e19f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.731629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ade9c-d666-40b3-9976-bed63c63e19f service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.742942 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1429/2831] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:16:59.752107 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1403/2832] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:16:59 2022] PUT /identity/v3/projects/a82d4e9493c24d92a6d7dbb23f4b5387/users/f2c15e3b7f3a42dc848ddd1ccdb9c7a6/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 18:16:59.762587 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2df2da-562c-4a47-9029-afa3a9341a20 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.762999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2df2da-562c-4a47-9029-afa3a9341a20 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.763421 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2df2da-562c-4a47-9029-afa3a9341a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.792909 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-db2df2da-562c-4a47-9029-afa3a9341a20 None None] MFA Rules not processed for user `f2c15e3b7f3a42dc848ddd1ccdb9c7a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:16:59.794179 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-db2df2da-562c-4a47-9029-afa3a9341a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:59.874752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1430/2833] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:16:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:16:59.890982 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:59.911856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f0496-3151-4884-be5c-7300edd2df8c admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:16:59.913603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a10f0496-3151-4884-be5c-7300edd2df8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:16:59.950995 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:59.973181 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f0496-3151-4884-be5c-7300edd2df8c admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:16:59.977470 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88965ea7-c614-40f2-895c-bede79e16037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:16:59.978075 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88965ea7-c614-40f2-895c-bede79e16037 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:16:59.978357 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88965ea7-c614-40f2-895c-bede79e16037 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:16:59.978633 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88965ea7-c614-40f2-895c-bede79e16037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:16:59.986906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88965ea7-c614-40f2-895c-bede79e16037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:16:59.988337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88965ea7-c614-40f2-895c-bede79e16037 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:16:59.999276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1404/2834] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:16:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:00.022301 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2df2da-562c-4a47-9029-afa3a9341a20 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:00.089276 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2df2da-562c-4a47-9029-afa3a9341a20 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:00.094282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:00.094930 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:00.095214 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:00.095490 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] PATH_INFO: `/v3/users/f2c15e3b7f3a42dc848ddd1ccdb9c7a6` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:00.096684 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c15e3b7f3a42dc848ddd1ccdb9c7a6)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:00.098616 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:00.319887 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c15e3b7f3a42dc848ddd1ccdb9c7a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.321272 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c15e3b7f3a42dc848ddd1ccdb9c7a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.328267 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c15e3b7f3a42dc848ddd1ccdb9c7a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.329116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c15e3b7f3a42dc848ddd1ccdb9c7a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.343978 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c15e3b7f3a42dc848ddd1ccdb9c7a6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:00.475054 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1431/2835] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:00 2022] DELETE /identity/v3/users/f2c15e3b7f3a42dc848ddd1ccdb9c7a6 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:00.476647 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2a415-dd31-47ad-805a-53757062b51e None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:00.477163 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2a415-dd31-47ad-805a-53757062b51e None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:00.477252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2a415-dd31-47ad-805a-53757062b51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:00.496881 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c9a2a415-dd31-47ad-805a-53757062b51e None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:00.504288 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c9a2a415-dd31-47ad-805a-53757062b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:00.573179 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1405/2836] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:00.584327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:00.586528 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:00.654363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3594e5-09cd-42c3-a934-50f3cfe973ee admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:00.658026 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de99aa-4826-4aff-a5ef-a6f62132aa53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:00.658666 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de99aa-4826-4aff-a5ef-a6f62132aa53 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:00.658946 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de99aa-4826-4aff-a5ef-a6f62132aa53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:00.659226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de99aa-4826-4aff-a5ef-a6f62132aa53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:00.670221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de99aa-4826-4aff-a5ef-a6f62132aa53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:00.671599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de99aa-4826-4aff-a5ef-a6f62132aa53 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:00.687101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1432/2837] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:01.303254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2a415-dd31-47ad-805a-53757062b51e None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:01.305386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c9a2a415-dd31-47ad-805a-53757062b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:01.318971 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2a415-dd31-47ad-805a-53757062b51e None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:01.324414 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:01.327302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:01.327302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:01.327302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] PATH_INFO: `/v3/projects/a82d4e9493c24d92a6d7dbb23f4b5387` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:01.327302 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82d4e9493c24d92a6d7dbb23f4b5387)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:01.328743 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:01.500980 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82d4e9493c24d92a6d7dbb23f4b5387', 'request_id': 'req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.503603 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82d4e9493c24d92a6d7dbb23f4b5387', 'request_id': 'req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.598825 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82d4e9493c24d92a6d7dbb23f4b5387', 'request_id': 'req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.611350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] The token cache is being invalidate because project a82d4e9493c24d92a6d7dbb23f4b5387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:01.611645 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.612539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-0e9eaae6-583a-4e48-9082-5c3b77d9d15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:01.614008 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1406/2838] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:01 2022] DELETE /identity/v3/projects/a82d4e9493c24d92a6d7dbb23f4b5387 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:01.619439 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee76011-1076-4abe-9579-8fbc26be8d76 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:01.619960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee76011-1076-4abe-9579-8fbc26be8d76 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:01.620073 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee76011-1076-4abe-9579-8fbc26be8d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:01.639960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8ee76011-1076-4abe-9579-8fbc26be8d76 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:01.641190 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8ee76011-1076-4abe-9579-8fbc26be8d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:01.650554 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:01.700751 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1433/2839] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:01.718231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa85c-5e39-400b-8c8f-165541c8e256 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:01.718231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa85c-5e39-400b-8c8f-165541c8e256 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:01.718231 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa85c-5e39-400b-8c8f-165541c8e256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:01.730080 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-f39fa85c-5e39-400b-8c8f-165541c8e256 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:01.731291 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-f39fa85c-5e39-400b-8c8f-165541c8e256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:01.739380 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1407/2840] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:01.749037 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee76011-1076-4abe-9579-8fbc26be8d76 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:01.758853 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee76011-1076-4abe-9579-8fbc26be8d76 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:01.765131 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:01.765754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:01.766033 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:01.766303 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:01.767006 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:01.767312 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:01.768983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:01.788722 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1434/2841] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:17:01.793702 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fa85c-5e39-400b-8c8f-165541c8e256 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:01.804212 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fa85c-5e39-400b-8c8f-165541c8e256 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:01.810000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9694d-f27e-4589-9302-4c32778459cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:01.811344 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9694d-f27e-4589-9302-4c32778459cc admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:01.811627 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9694d-f27e-4589-9302-4c32778459cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:01.811902 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9694d-f27e-4589-9302-4c32778459cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:01.812635 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9694d-f27e-4589-9302-4c32778459cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:01.814576 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9694d-f27e-4589-9302-4c32778459cc admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:01.831242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:01.832191 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:01.889028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46416fe1-12f9-4488-84d3-794287183832 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:01.892674 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72cdc-e163-4661-b9d3-c50147291aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:01.893305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72cdc-e163-4661-b9d3-c50147291aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:01.893588 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72cdc-e163-4661-b9d3-c50147291aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:01.893865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72cdc-e163-4661-b9d3-c50147291aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:01.895637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2ec72cdc-e163-4661-b9d3-c50147291aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:01.926128 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1408/2842] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:01 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:01.930928 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9694d-f27e-4589-9302-4c32778459cc admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:01.956841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72cdc-e163-4661-b9d3-c50147291aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:01.958246 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72cdc-e163-4661-b9d3-c50147291aa5 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:01.965976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:01.967512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1435/2843] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:17:01.994844 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9694d-f27e-4589-9302-4c32778459cc admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:01.999650 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8e17a-4c8a-42bb-93a0-d9fa545758db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:02.000283 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8e17a-4c8a-42bb-93a0-d9fa545758db admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:02.000565 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8e17a-4c8a-42bb-93a0-d9fa545758db admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:02.000880 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8e17a-4c8a-42bb-93a0-d9fa545758db admin admin] PATH_INFO: `/v3/users` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:02.001539 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8e17a-4c8a-42bb-93a0-d9fa545758db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:02.003457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8e17a-4c8a-42bb-93a0-d9fa545758db admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:02.108745 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1409/2844] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:01 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:17:02.112239 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72cdc-e163-4661-b9d3-c50147291aa5 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:02.124181 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72cdc-e163-4661-b9d3-c50147291aa5 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:02.129062 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d6556-8e5e-40ab-97ba-4e1a69f3723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:02.129704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d6556-8e5e-40ab-97ba-4e1a69f3723e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:02.129987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d6556-8e5e-40ab-97ba-4e1a69f3723e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:02.130262 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d6556-8e5e-40ab-97ba-4e1a69f3723e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:02.130955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d6556-8e5e-40ab-97ba-4e1a69f3723e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:02.132573 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d6556-8e5e-40ab-97ba-4e1a69f3723e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:02.142540 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1436/2845] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:02.151295 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8e17a-4c8a-42bb-93a0-d9fa545758db admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:02.161201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8e17a-4c8a-42bb-93a0-d9fa545758db admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:02.166634 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac015f-de75-4d32-896b-03a1219ac7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:02.167277 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac015f-de75-4d32-896b-03a1219ac7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:02.167555 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac015f-de75-4d32-896b-03a1219ac7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:02.167834 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac015f-de75-4d32-896b-03a1219ac7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:02.168530 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac015f-de75-4d32-896b-03a1219ac7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:02.170157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac015f-de75-4d32-896b-03a1219ac7dd admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:02.184963 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1410/2846] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:02.189101 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d6556-8e5e-40ab-97ba-4e1a69f3723e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:02.199561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d6556-8e5e-40ab-97ba-4e1a69f3723e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:02.204228 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c980a00-f16c-4bba-a37d-ab6666fd910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:02.204910 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c980a00-f16c-4bba-a37d-ab6666fd910a admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:02.205194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c980a00-f16c-4bba-a37d-ab6666fd910a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:02.205466 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c980a00-f16c-4bba-a37d-ab6666fd910a admin admin] PATH_INFO: `/v3/projects/88ffef3f582c4832bc7caffc43373cc7/users/2634a93ff3b04bbab9fb4ba3af106a98/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:02.220974 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c980a00-f16c-4bba-a37d-ab6666fd910a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ffef3f582c4832bc7caffc43373cc7, user_id=2634a93ff3b04bbab9fb4ba3af106a98, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:02.223545 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c980a00-f16c-4bba-a37d-ab6666fd910a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:02.325817 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1437/2847] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:02 2022] PUT /identity/v3/projects/88ffef3f582c4832bc7caffc43373cc7/users/2634a93ff3b04bbab9fb4ba3af106a98/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:02.336677 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9d896-7fd0-4230-9e36-47686f24166d None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:02.340178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9d896-7fd0-4230-9e36-47686f24166d None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:02.340178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9d896-7fd0-4230-9e36-47686f24166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:02.365694 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-9eb9d896-7fd0-4230-9e36-47686f24166d None None] MFA Rules not processed for user `2634a93ff3b04bbab9fb4ba3af106a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:02.367439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-9eb9d896-7fd0-4230-9e36-47686f24166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:02.430841 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1411/2848] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:02.441444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c980a00-f16c-4bba-a37d-ab6666fd910a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:02.443209 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4c980a00-f16c-4bba-a37d-ab6666fd910a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:02.469249 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:02.498842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c980a00-f16c-4bba-a37d-ab6666fd910a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:02.502629 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff44afd-7d26-4069-8050-a5446f75f0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:02.503307 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff44afd-7d26-4069-8050-a5446f75f0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:02.503655 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff44afd-7d26-4069-8050-a5446f75f0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:02.503987 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff44afd-7d26-4069-8050-a5446f75f0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:02.513560 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff44afd-7d26-4069-8050-a5446f75f0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:02.514986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff44afd-7d26-4069-8050-a5446f75f0e6 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:02.523888 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1438/2849] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:03.935732 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9d896-7fd0-4230-9e36-47686f24166d None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:03.946269 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9d896-7fd0-4230-9e36-47686f24166d None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:03.950040 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:03.955118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:03.955118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:03.955118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:03.955118 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:04.016340 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:04.017796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:04.027449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1412/2850] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:04.388238 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d1490-fd5e-4e2d-951c-9034647e611b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:04.388766 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d1490-fd5e-4e2d-951c-9034647e611b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:04.388903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d1490-fd5e-4e2d-951c-9034647e611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:04.407577 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7d8d1490-fd5e-4e2d-951c-9034647e611b None None] MFA Rules not processed for user `2634a93ff3b04bbab9fb4ba3af106a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:04.408772 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7d8d1490-fd5e-4e2d-951c-9034647e611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:04.416215 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1439/2851] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:06.026891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:06.028419 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:06.071828 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:06.104112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19429e6d-2ed2-49be-9a11-b937b0561605 service cinder] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:06.109397 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:06.110364 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:06.110467 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:06.110654 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] PATH_INFO: `/v3/users/0d803e12de614aa2a92a33860a4e39af` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:06.111866 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d803e12de614aa2a92a33860a4e39af)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:06.114002 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:06.430872 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d803e12de614aa2a92a33860a4e39af'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:06.431574 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d803e12de614aa2a92a33860a4e39af'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:06.536320 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d803e12de614aa2a92a33860a4e39af'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:06.537014 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d803e12de614aa2a92a33860a4e39af'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:06.549594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d803e12de614aa2a92a33860a4e39af'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:06.563253 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1413/2852] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:06 2022] DELETE /identity/v3/users/0d803e12de614aa2a92a33860a4e39af => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:06.567606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c9e10-5c95-483e-a802-247a17ca6a82 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:06.568109 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c9e10-5c95-483e-a802-247a17ca6a82 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:06.568200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c9e10-5c95-483e-a802-247a17ca6a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:06.587590 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1b7c9e10-5c95-483e-a802-247a17ca6a82 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:06.588841 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1b7c9e10-5c95-483e-a802-247a17ca6a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:06.646912 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1440/2853] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:06.656977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:06.658427 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:06.720800 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e196d6-2585-4017-9f04-e164b9fb501c admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:06.724389 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a0f8-5ffc-4126-a4ea-c495208c983f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:06.725046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a0f8-5ffc-4126-a4ea-c495208c983f service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:06.725330 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a0f8-5ffc-4126-a4ea-c495208c983f service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:06.725619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6a0f8-5ffc-4126-a4ea-c495208c983f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:06.735520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6a0f8-5ffc-4126-a4ea-c495208c983f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:06.736891 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6a0f8-5ffc-4126-a4ea-c495208c983f service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:06.740728 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c9e10-5c95-483e-a802-247a17ca6a82 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:06.742287 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1b7c9e10-5c95-483e-a802-247a17ca6a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:06.747422 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1414/2854] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:06.836625 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c9e10-5c95-483e-a802-247a17ca6a82 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:06.841858 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2003907-2fd7-476c-bdef-21a897606795 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:06.842468 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2003907-2fd7-476c-bdef-21a897606795 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:06.842753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2003907-2fd7-476c-bdef-21a897606795 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:06.843025 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2003907-2fd7-476c-bdef-21a897606795 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:06.845074 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d2003907-2fd7-476c-bdef-21a897606795 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:06.856765 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2003907-2fd7-476c-bdef-21a897606795 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:06.858344 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2003907-2fd7-476c-bdef-21a897606795 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:06.868126 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1441/2855] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:17:07.252744 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a0f8-5ffc-4126-a4ea-c495208c983f service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:07.254218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-b9c6a0f8-5ffc-4126-a4ea-c495208c983f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:07.268218 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6a0f8-5ffc-4126-a4ea-c495208c983f service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:07.273811 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:07.274458 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:07.274771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:07.275079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] PATH_INFO: `/v3/projects/e7884b1160924969842011fafe7adad2` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:07.276572 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7884b1160924969842011fafe7adad2)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:07.278546 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:07.468699 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7884b1160924969842011fafe7adad2', 'request_id': 'req-e0c1f452-f680-4a87-822b-5f47c74f1b6c'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:07.470703 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:07.475180 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7884b1160924969842011fafe7adad2', 'request_id': 'req-e0c1f452-f680-4a87-822b-5f47c74f1b6c'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:07.553423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7884b1160924969842011fafe7adad2', 'request_id': 'req-e0c1f452-f680-4a87-822b-5f47c74f1b6c'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:07.564989 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] The token cache is being invalidate because project e7884b1160924969842011fafe7adad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:07.565276 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:07.565919 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-e0c1f452-f680-4a87-822b-5f47c74f1b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:07.567415 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1415/2856] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:07 2022] DELETE /identity/v3/projects/e7884b1160924969842011fafe7adad2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:07.572254 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646159-ace5-4058-88f5-1669d1496006 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:07.572745 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646159-ace5-4058-88f5-1669d1496006 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:07.572895 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646159-ace5-4058-88f5-1669d1496006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:07.592825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c0646159-ace5-4058-88f5-1669d1496006 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:07.594265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c0646159-ace5-4058-88f5-1669d1496006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:07.618691 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:07.651975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1442/2857] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:07.659886 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd8daa-601c-4cf8-b9c3-6c706eed55d0 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:07.660172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd8daa-601c-4cf8-b9c3-6c706eed55d0 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:07.660445 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd8daa-601c-4cf8-b9c3-6c706eed55d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:07.683050 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-c6bd8daa-601c-4cf8-b9c3-6c706eed55d0 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:07.683849 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-c6bd8daa-601c-4cf8-b9c3-6c706eed55d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:07.697151 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1416/2858] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:07.701844 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646159-ace5-4058-88f5-1669d1496006 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:07.719305 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646159-ace5-4058-88f5-1669d1496006 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:07.724764 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d4f4-925c-4e76-9bba-fc9eddcbb76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:07.725825 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d4f4-925c-4e76-9bba-fc9eddcbb76d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:07.726113 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d4f4-925c-4e76-9bba-fc9eddcbb76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:07.726397 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d4f4-925c-4e76-9bba-fc9eddcbb76d admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:07.727099 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d4f4-925c-4e76-9bba-fc9eddcbb76d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:07.727403 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d4f4-925c-4e76-9bba-fc9eddcbb76d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:07.729787 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d4f4-925c-4e76-9bba-fc9eddcbb76d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:07.742169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1443/2859] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 18:17:07.746397 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd8daa-601c-4cf8-b9c3-6c706eed55d0 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:07.755607 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd8daa-601c-4cf8-b9c3-6c706eed55d0 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:07.760432 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c874ee-9377-4c8c-9f4b-3d2b6e91fbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:07.761244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c874ee-9377-4c8c-9f4b-3d2b6e91fbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:07.761521 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c874ee-9377-4c8c-9f4b-3d2b6e91fbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:07.761792 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c874ee-9377-4c8c-9f4b-3d2b6e91fbe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:07.762449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c874ee-9377-4c8c-9f4b-3d2b6e91fbe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:07.764366 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c874ee-9377-4c8c-9f4b-3d2b6e91fbe7 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:07.864755 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1417/2860] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:07 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:17:07.869624 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d4f4-925c-4e76-9bba-fc9eddcbb76d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:07.880035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d4f4-925c-4e76-9bba-fc9eddcbb76d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:07.942842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54b3b6-ec3f-4f1a-bec8-1030bf436418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:07.943458 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54b3b6-ec3f-4f1a-bec8-1030bf436418 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:07.943734 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54b3b6-ec3f-4f1a-bec8-1030bf436418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:07.944001 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54b3b6-ec3f-4f1a-bec8-1030bf436418 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:07.944697 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54b3b6-ec3f-4f1a-bec8-1030bf436418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:07.946739 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54b3b6-ec3f-4f1a-bec8-1030bf436418 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:08.033870 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1444/2861] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:07 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 18:17:08.038312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c874ee-9377-4c8c-9f4b-3d2b6e91fbe7 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:08.049773 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c874ee-9377-4c8c-9f4b-3d2b6e91fbe7 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:08.054473 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a30fb-a477-4977-ad13-02698060da06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:08.055088 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a30fb-a477-4977-ad13-02698060da06 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:08.055375 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a30fb-a477-4977-ad13-02698060da06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:08.055658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a30fb-a477-4977-ad13-02698060da06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:08.056982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a30fb-a477-4977-ad13-02698060da06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:08.058578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a30fb-a477-4977-ad13-02698060da06 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:08.069447 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1418/2862] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:08.073701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54b3b6-ec3f-4f1a-bec8-1030bf436418 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:08.084884 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54b3b6-ec3f-4f1a-bec8-1030bf436418 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:08.089899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff6d8a-0cde-4e67-b06f-98fa479ebb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:08.090523 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff6d8a-0cde-4e67-b06f-98fa479ebb43 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:08.090805 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff6d8a-0cde-4e67-b06f-98fa479ebb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:08.091080 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff6d8a-0cde-4e67-b06f-98fa479ebb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:08.091781 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff6d8a-0cde-4e67-b06f-98fa479ebb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:08.093512 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff6d8a-0cde-4e67-b06f-98fa479ebb43 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:08.105501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1445/2863] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 18:17:08.113895 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a30fb-a477-4977-ad13-02698060da06 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:08.126158 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a30fb-a477-4977-ad13-02698060da06 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:08.132811 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48af12-47fd-4d93-bae2-4aaf3e0ad059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:08.133479 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48af12-47fd-4d93-bae2-4aaf3e0ad059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:08.133766 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48af12-47fd-4d93-bae2-4aaf3e0ad059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:08.134046 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48af12-47fd-4d93-bae2-4aaf3e0ad059 admin admin] PATH_INFO: `/v3/projects/f883f3cf2bdf4ddbad95b5a6f219e977/users/e2f81fd6327544f9869dd9d05b3f54cd/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:08.153461 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48af12-47fd-4d93-bae2-4aaf3e0ad059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f883f3cf2bdf4ddbad95b5a6f219e977, user_id=e2f81fd6327544f9869dd9d05b3f54cd, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:08.156123 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48af12-47fd-4d93-bae2-4aaf3e0ad059 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:08.259552 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1419/2864] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:08 2022] PUT /identity/v3/projects/f883f3cf2bdf4ddbad95b5a6f219e977/users/e2f81fd6327544f9869dd9d05b3f54cd/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:08.271598 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e648df-030c-4f16-8520-6d61f9046c23 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:08.271881 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e648df-030c-4f16-8520-6d61f9046c23 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:08.272160 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e648df-030c-4f16-8520-6d61f9046c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:08.317599 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-08e648df-030c-4f16-8520-6d61f9046c23 None None] MFA Rules not processed for user `e2f81fd6327544f9869dd9d05b3f54cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:08.319076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-08e648df-030c-4f16-8520-6d61f9046c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:08.417643 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1446/2865] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:08.429323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48af12-47fd-4d93-bae2-4aaf3e0ad059 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:08.431070 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-8b48af12-47fd-4d93-bae2-4aaf3e0ad059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:08.490783 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48af12-47fd-4d93-bae2-4aaf3e0ad059 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:08.494901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c93a45-7f25-4824-951c-28bba58c4be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a4c879f65c24edea2404cb74ac37025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:08.495499 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c93a45-7f25-4824-951c-28bba58c4be4 service cinder] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:08.495781 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c93a45-7f25-4824-951c-28bba58c4be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:08.496060 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c93a45-7f25-4824-951c-28bba58c4be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:08.505011 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c93a45-7f25-4824-951c-28bba58c4be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:08.506550 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c93a45-7f25-4824-951c-28bba58c4be4 service cinder] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:08.515975 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1420/2866] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:08.809744 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e648df-030c-4f16-8520-6d61f9046c23 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:08.811242 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-08e648df-030c-4f16-8520-6d61f9046c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:08.841717 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:08.880478 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e648df-030c-4f16-8520-6d61f9046c23 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:08.885521 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:08.886169 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:08.886480 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:08.886754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] PATH_INFO: `/v3/users/630e281a1030423a962ae4e936365dec` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:08.887926 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630e281a1030423a962ae4e936365dec)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:08.889999 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:09.176119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630e281a1030423a962ae4e936365dec'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:09.180960 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630e281a1030423a962ae4e936365dec'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:09.186185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630e281a1030423a962ae4e936365dec'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:09.187044 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630e281a1030423a962ae4e936365dec'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:09.201988 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630e281a1030423a962ae4e936365dec'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:09.274476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1447/2867] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:08 2022] DELETE /identity/v3/users/630e281a1030423a962ae4e936365dec => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:09.279074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96317189-b570-42da-9616-80aa1cf581d5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:09.279571 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96317189-b570-42da-9616-80aa1cf581d5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:09.279771 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96317189-b570-42da-9616-80aa1cf581d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:09.300705 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-96317189-b570-42da-9616-80aa1cf581d5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:09.301976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-96317189-b570-42da-9616-80aa1cf581d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:09.368646 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1421/2868] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:09.378502 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:09.380010 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:09.459694 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439ecd7-1006-45ce-90c0-469747f523a4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:09.464145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947f98-352f-4d3f-955a-41d921bf3231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:09.468292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947f98-352f-4d3f-955a-41d921bf3231 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:09.468292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947f98-352f-4d3f-955a-41d921bf3231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:09.468292 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947f98-352f-4d3f-955a-41d921bf3231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:09.483162 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c947f98-352f-4d3f-955a-41d921bf3231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:09.484757 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c947f98-352f-4d3f-955a-41d921bf3231 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:09.497438 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1448/2869] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:10.121066 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96317189-b570-42da-9616-80aa1cf581d5 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:10.122496 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-96317189-b570-42da-9616-80aa1cf581d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:10.134503 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96317189-b570-42da-9616-80aa1cf581d5 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:10.150239 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:10.150911 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:10.151191 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:10.151463 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] PATH_INFO: `/v3/projects/d319242128ef47b6b4aa0395c79f3260` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:10.152678 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d319242128ef47b6b4aa0395c79f3260)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:10.154587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:10.173336 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:10.356538 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd319242128ef47b6b4aa0395c79f3260', 'request_id': 'req-a2457a58-57d0-4775-806a-f6bfd93a0cf1'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.366469 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd319242128ef47b6b4aa0395c79f3260', 'request_id': 'req-a2457a58-57d0-4775-806a-f6bfd93a0cf1'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.485045 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd319242128ef47b6b4aa0395c79f3260', 'request_id': 'req-a2457a58-57d0-4775-806a-f6bfd93a0cf1'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.496953 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] The token cache is being invalidate because project d319242128ef47b6b4aa0395c79f3260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:10.497244 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.497901 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.499741 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1422/2870] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:10 2022] DELETE /identity/v3/projects/d319242128ef47b6b4aa0395c79f3260 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:10.503470 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947f98-352f-4d3f-955a-41d921bf3231 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:10.513748 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947f98-352f-4d3f-955a-41d921bf3231 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:10.561378 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:10.575268 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:10.576077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:10.576339 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:10.576614 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] PATH_INFO: `/v3/users/92822e198a5f461281c7a75cd18a928f` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:10.577955 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92822e198a5f461281c7a75cd18a928f)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:10.579890 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:10.859273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92822e198a5f461281c7a75cd18a928f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.859980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92822e198a5f461281c7a75cd18a928f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.866949 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92822e198a5f461281c7a75cd18a928f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.867592 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92822e198a5f461281c7a75cd18a928f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.879777 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92822e198a5f461281c7a75cd18a928f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:10.998035 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1449/2871] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:10 2022] DELETE /identity/v3/users/92822e198a5f461281c7a75cd18a928f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:11.475041 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:11.476532 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:11.490877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457a58-57d0-4775-806a-f6bfd93a0cf1 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:11.549455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:11.550116 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:11.550393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:11.550664 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] PATH_INFO: `/v3/projects/03e8b44a23bc4db88ee37f82ff8beb02` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:11.551812 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e8b44a23bc4db88ee37f82ff8beb02)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:11.553777 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:11.690819 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e8b44a23bc4db88ee37f82ff8beb02', 'request_id': 'req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:11.696558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e8b44a23bc4db88ee37f82ff8beb02', 'request_id': 'req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:11.764625 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e8b44a23bc4db88ee37f82ff8beb02', 'request_id': 'req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:11.776434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] The token cache is being invalidate because project 03e8b44a23bc4db88ee37f82ff8beb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:11.776731 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:11.777932 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:11.779435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1423/2872] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:11 2022] DELETE /identity/v3/projects/03e8b44a23bc4db88ee37f82ff8beb02 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:11.783485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:11.784984 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:11.798375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb27fb-79f7-4f14-ad4c-439ca950453d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:11.858501 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:11.859322 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:11.859704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:11.860130 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] PATH_INFO: `/v3/users/b0eff02456c445e7b575e60180eb2a94` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:11.861411 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0eff02456c445e7b575e60180eb2a94)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:11.863664 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:12.150255 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0eff02456c445e7b575e60180eb2a94'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:12.150911 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0eff02456c445e7b575e60180eb2a94'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:12.158068 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0eff02456c445e7b575e60180eb2a94'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:12.158785 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0eff02456c445e7b575e60180eb2a94'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:12.167899 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:12.173151 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc7ceab4-f90c-459c-ad8d-166a1cccb063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0eff02456c445e7b575e60180eb2a94'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:12.302863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1450/2873] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:11 2022] DELETE /identity/v3/users/b0eff02456c445e7b575e60180eb2a94 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:12.743044 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:12.744614 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:12.759312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1f05b-82b0-453d-aec1-f85c333c4cc4 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:12.792236 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:12.824112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:12.824864 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:12.825152 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:12.825431 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] PATH_INFO: `/v3/projects/46914dde4bf8411f8cd3028ff5dae92c` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:12.826587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46914dde4bf8411f8cd3028ff5dae92c)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:12.828660 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:12.977578 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46914dde4bf8411f8cd3028ff5dae92c', 'request_id': 'req-12da5022-dc35-4979-9f75-15e14a152891'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:12.983631 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46914dde4bf8411f8cd3028ff5dae92c', 'request_id': 'req-12da5022-dc35-4979-9f75-15e14a152891'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:13.056870 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46914dde4bf8411f8cd3028ff5dae92c', 'request_id': 'req-12da5022-dc35-4979-9f75-15e14a152891'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:13.068842 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] The token cache is being invalidate because project 46914dde4bf8411f8cd3028ff5dae92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:13.070845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:13.070845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-12da5022-dc35-4979-9f75-15e14a152891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:13.071751 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1424/2874] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:12 2022] DELETE /identity/v3/projects/46914dde4bf8411f8cd3028ff5dae92c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:13.077134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14bf7a-4566-4f6b-a3bc-b2f7e3887b4c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:13.077606 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14bf7a-4566-4f6b-a3bc-b2f7e3887b4c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:13.077706 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14bf7a-4566-4f6b-a3bc-b2f7e3887b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:13.098304 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ab14bf7a-4566-4f6b-a3bc-b2f7e3887b4c None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:13.099525 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ab14bf7a-4566-4f6b-a3bc-b2f7e3887b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:13.169656 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1451/2875] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:13.177598 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8a4b-b521-4313-884e-9a86748ed059 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:13.177904 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8a4b-b521-4313-884e-9a86748ed059 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:13.178177 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8a4b-b521-4313-884e-9a86748ed059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:13.198230 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-500b8a4b-b521-4313-884e-9a86748ed059 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:13.199977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-500b8a4b-b521-4313-884e-9a86748ed059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:13.207835 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1425/2876] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:13.212028 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14bf7a-4566-4f6b-a3bc-b2f7e3887b4c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:13.222760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14bf7a-4566-4f6b-a3bc-b2f7e3887b4c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:13.227600 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372113f6-eca3-4126-9b9b-e3e6597001c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:13.228223 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372113f6-eca3-4126-9b9b-e3e6597001c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:13.228499 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372113f6-eca3-4126-9b9b-e3e6597001c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:13.228769 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372113f6-eca3-4126-9b9b-e3e6597001c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:13.229485 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372113f6-eca3-4126-9b9b-e3e6597001c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 18:17:13.229783 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372113f6-eca3-4126-9b9b-e3e6597001c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:13.231639 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372113f6-eca3-4126-9b9b-e3e6597001c7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:13.247842 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1452/2877] 10.222.0.67 () {58 vars in 1153 bytes} [Thu Jul 28 18:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 18:17:13.248988 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b8a4b-b521-4313-884e-9a86748ed059 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:13.259575 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b8a4b-b521-4313-884e-9a86748ed059 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:13.264893 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e771503-3e79-4130-a0db-a5fcd804f0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:13.265529 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e771503-3e79-4130-a0db-a5fcd804f0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:13.265957 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e771503-3e79-4130-a0db-a5fcd804f0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:13.266637 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e771503-3e79-4130-a0db-a5fcd804f0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:13.270795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e771503-3e79-4130-a0db-a5fcd804f0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:13.270795 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e771503-3e79-4130-a0db-a5fcd804f0e8 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:13.372856 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1426/2878] 10.222.0.67 () {60 vars in 1153 bytes} [Thu Jul 28 18:17:13 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:17:13.377319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372113f6-eca3-4126-9b9b-e3e6597001c7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:13.387970 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372113f6-eca3-4126-9b9b-e3e6597001c7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:13.444061 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c77c3a-a649-4ba1-90ba-7af3191a9f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:13.444596 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c77c3a-a649-4ba1-90ba-7af3191a9f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:13.444907 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c77c3a-a649-4ba1-90ba-7af3191a9f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:13.445184 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c77c3a-a649-4ba1-90ba-7af3191a9f11 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:13.445865 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c77c3a-a649-4ba1-90ba-7af3191a9f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:13.447778 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c77c3a-a649-4ba1-90ba-7af3191a9f11 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:13.582154 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1453/2879] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 28 18:17:13 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 18:17:13.586369 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e771503-3e79-4130-a0db-a5fcd804f0e8 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:13.596937 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e771503-3e79-4130-a0db-a5fcd804f0e8 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:13.601558 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d457693-87f9-4601-8ffd-d7285863aee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:13.602164 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457693-87f9-4601-8ffd-d7285863aee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:13.602441 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457693-87f9-4601-8ffd-d7285863aee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:13.602759 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457693-87f9-4601-8ffd-d7285863aee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:13.603455 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d457693-87f9-4601-8ffd-d7285863aee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:13.605076 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d457693-87f9-4601-8ffd-d7285863aee7 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:13.615078 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1427/2880] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:13.619071 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c77c3a-a649-4ba1-90ba-7af3191a9f11 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:13.629546 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c77c3a-a649-4ba1-90ba-7af3191a9f11 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:13.634290 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb5a1c-47cd-40d4-b762-a56be632ca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:13.634886 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5a1c-47cd-40d4-b762-a56be632ca13 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:13.635265 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5a1c-47cd-40d4-b762-a56be632ca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:13.637496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5a1c-47cd-40d4-b762-a56be632ca13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:13.637496 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb5a1c-47cd-40d4-b762-a56be632ca13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:13.638556 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb5a1c-47cd-40d4-b762-a56be632ca13 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:13.649066 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1454/2881] 10.222.0.67 () {58 vars in 1122 bytes} [Thu Jul 28 18:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 18:17:13.653260 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d457693-87f9-4601-8ffd-d7285863aee7 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:13.662990 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d457693-87f9-4601-8ffd-d7285863aee7 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:13.667523 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c1ee-8fb0-4dde-9a75-d23818482388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:13.668172 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c1ee-8fb0-4dde-9a75-d23818482388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:13.668449 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c1ee-8fb0-4dde-9a75-d23818482388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:13.668721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c1ee-8fb0-4dde-9a75-d23818482388 admin admin] PATH_INFO: `/v3/projects/362b2aece2dd4d078d31595168daebdd/users/33f30a97306b4a81a9790dbb27df736d/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:13.683667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609c1ee-8fb0-4dde-9a75-d23818482388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362b2aece2dd4d078d31595168daebdd, user_id=33f30a97306b4a81a9790dbb27df736d, role_id=abf079771c8d4ef7a6cfa0b3bedfe1c0)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:13.686303 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609c1ee-8fb0-4dde-9a75-d23818482388 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:13.851012 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1428/2882] 10.222.0.67 () {60 vars in 1483 bytes} [Thu Jul 28 18:17:13 2022] PUT /identity/v3/projects/362b2aece2dd4d078d31595168daebdd/users/33f30a97306b4a81a9790dbb27df736d/roles/abf079771c8d4ef7a6cfa0b3bedfe1c0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:13.868963 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a24a32-8ed2-4488-ae0f-ab35768964d1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:13.869277 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a24a32-8ed2-4488-ae0f-ab35768964d1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:13.869584 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a24a32-8ed2-4488-ae0f-ab35768964d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:13.898827 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-62a24a32-8ed2-4488-ae0f-ab35768964d1 None None] MFA Rules not processed for user `33f30a97306b4a81a9790dbb27df736d`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:13.900070 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-62a24a32-8ed2-4488-ae0f-ab35768964d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:13.941731 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:13.965319 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1455/2883] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:13.977062 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c1ee-8fb0-4dde-9a75-d23818482388 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:13.978984 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5609c1ee-8fb0-4dde-9a75-d23818482388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:14.035656 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c1ee-8fb0-4dde-9a75-d23818482388 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:14.039286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6e7f5-3658-4091-9b11-26904d3960f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18138af1ea504faca84b0cc2034ddd36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:14.039889 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6e7f5-3658-4091-9b11-26904d3960f8 service glance] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:14.040166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6e7f5-3658-4091-9b11-26904d3960f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:14.040434 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6e7f5-3658-4091-9b11-26904d3960f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:14.049223 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6e7f5-3658-4091-9b11-26904d3960f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:14.050570 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6e7f5-3658-4091-9b11-26904d3960f8 service glance] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:14.055043 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:14.059600 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1429/2884] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:14.881316 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a24a32-8ed2-4488-ae0f-ab35768964d1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:14.882754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-62a24a32-8ed2-4488-ae0f-ab35768964d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:14.975822 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a24a32-8ed2-4488-ae0f-ab35768964d1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:14.981818 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:14.982476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:14.982753 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:14.983018 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] PATH_INFO: `/v3/users/e2f81fd6327544f9869dd9d05b3f54cd` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:14.984202 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f81fd6327544f9869dd9d05b3f54cd)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:14.986194 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:15.247615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f81fd6327544f9869dd9d05b3f54cd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:15.248261 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f81fd6327544f9869dd9d05b3f54cd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:15.255422 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f81fd6327544f9869dd9d05b3f54cd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:15.256103 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f81fd6327544f9869dd9d05b3f54cd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:15.270900 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f81fd6327544f9869dd9d05b3f54cd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:15.361297 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1456/2885] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:14 2022] DELETE /identity/v3/users/e2f81fd6327544f9869dd9d05b3f54cd => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:15.365673 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd84a84-6371-4a56-ba37-4d3258f73fe5 None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:15.366551 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd84a84-6371-4a56-ba37-4d3258f73fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:15.367065 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd84a84-6371-4a56-ba37-4d3258f73fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:15.386125 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-cdd84a84-6371-4a56-ba37-4d3258f73fe5 None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:15.387829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cdd84a84-6371-4a56-ba37-4d3258f73fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:15.450970 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1430/2886] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:15.461919 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:15.463809 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:15.529313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe193-5680-4b0e-b176-d4648e58e116 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:15.533078 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950f163-bc14-4ad8-bd68-86cd735e88b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:15.533686 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950f163-bc14-4ad8-bd68-86cd735e88b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:15.533966 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950f163-bc14-4ad8-bd68-86cd735e88b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:15.534237 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950f163-bc14-4ad8-bd68-86cd735e88b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:15.543604 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950f163-bc14-4ad8-bd68-86cd735e88b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:15.545053 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950f163-bc14-4ad8-bd68-86cd735e88b0 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:15.554396 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1457/2887] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:16.036526 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd84a84-6371-4a56-ba37-4d3258f73fe5 None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:16.036811 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-cdd84a84-6371-4a56-ba37-4d3258f73fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:16.054951 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd84a84-6371-4a56-ba37-4d3258f73fe5 None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:16.065726 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:16.066385 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:16.072982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:16.072982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] PATH_INFO: `/v3/projects/f883f3cf2bdf4ddbad95b5a6f219e977` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:16.072982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f883f3cf2bdf4ddbad95b5a6f219e977)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:16.072982 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:16.195166 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f883f3cf2bdf4ddbad95b5a6f219e977', 'request_id': 'req-989ed049-d384-412a-b809-c0e565274b12'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:16.200863 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f883f3cf2bdf4ddbad95b5a6f219e977', 'request_id': 'req-989ed049-d384-412a-b809-c0e565274b12'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:16.301845 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f883f3cf2bdf4ddbad95b5a6f219e977', 'request_id': 'req-989ed049-d384-412a-b809-c0e565274b12'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:16.314308 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] The token cache is being invalidate because project f883f3cf2bdf4ddbad95b5a6f219e977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:16.314621 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:16.315298 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:16.318439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1431/2888] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:16 2022] DELETE /identity/v3/projects/f883f3cf2bdf4ddbad95b5a6f219e977 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:23.187195 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de90b3-bcc8-48da-883a-2b70f1e22424 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:23.187676 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de90b3-bcc8-48da-883a-2b70f1e22424 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:23.187784 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de90b3-bcc8-48da-883a-2b70f1e22424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:23.193104 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:23.217752 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-54de90b3-bcc8-48da-883a-2b70f1e22424 None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:23.219008 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-54de90b3-bcc8-48da-883a-2b70f1e22424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:23.275704 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1458/2889] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:17:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:23.432323 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:23.434284 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:23.502784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ed049-d384-412a-b809-c0e565274b12 admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:23.507806 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fbee8-61d9-4481-8fb0-d48ff8512f14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:23.508435 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fbee8-61d9-4481-8fb0-d48ff8512f14 service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:23.508747 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fbee8-61d9-4481-8fb0-d48ff8512f14 service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:23.509028 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fbee8-61d9-4481-8fb0-d48ff8512f14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:23.517619 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fbee8-61d9-4481-8fb0-d48ff8512f14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:23.519174 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fbee8-61d9-4481-8fb0-d48ff8512f14 service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:23.527061 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1432/2890] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:17:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:17:24.422259 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59f7e1-dcee-49a5-82c2-0e3c5022088c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:24.422754 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59f7e1-dcee-49a5-82c2-0e3c5022088c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:24.422863 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59f7e1-dcee-49a5-82c2-0e3c5022088c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:24.442975 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cf59f7e1-dcee-49a5-82c2-0e3c5022088c None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:24.444185 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cf59f7e1-dcee-49a5-82c2-0e3c5022088c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:24.451936 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1459/2891] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 28 18:17:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:24.465423 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fbee8-61d9-4481-8fb0-d48ff8512f14 service swift] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:24.476337 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fbee8-61d9-4481-8fb0-d48ff8512f14 service swift] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:24.486438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf650c-2863-4755-82ca-3468021e3c00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:24.486438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf650c-2863-4755-82ca-3468021e3c00 service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:24.486438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf650c-2863-4755-82ca-3468021e3c00 service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:24.486438 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf650c-2863-4755-82ca-3468021e3c00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:24.491583 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf650c-2863-4755-82ca-3468021e3c00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:24.493178 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf650c-2863-4755-82ca-3468021e3c00 service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:24.498300 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:24.502071 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1433/2892] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:17:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:17:25.191935 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644f8fc-c032-43aa-95fa-632642dfeafc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:25.192241 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644f8fc-c032-43aa-95fa-632642dfeafc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:25.192561 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644f8fc-c032-43aa-95fa-632642dfeafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:25.213796 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0644f8fc-c032-43aa-95fa-632642dfeafc None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:25.215736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0644f8fc-c032-43aa-95fa-632642dfeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:25.223221 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1460/2893] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 28 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:25.235214 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf650c-2863-4755-82ca-3468021e3c00 service swift] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:25.246101 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf650c-2863-4755-82ca-3468021e3c00 service swift] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:25.251201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff2fa-8a55-4e66-a5d4-5e466001211b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:25.251796 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff2fa-8a55-4e66-a5d4-5e466001211b service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:25.252074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff2fa-8a55-4e66-a5d4-5e466001211b service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:25.252350 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff2fa-8a55-4e66-a5d4-5e466001211b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:25.260250 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cff2fa-8a55-4e66-a5d4-5e466001211b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:25.262393 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cff2fa-8a55-4e66-a5d4-5e466001211b service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:25.271265 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1434/2894] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:17:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:17:25.951348 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495da33-6829-4166-806a-6dd37b3be6e6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:25.951821 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495da33-6829-4166-806a-6dd37b3be6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:25.951925 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495da33-6829-4166-806a-6dd37b3be6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:25.971170 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8495da33-6829-4166-806a-6dd37b3be6e6 None None] MFA Rules not processed for user `36f4189de0674590a257d9de7a60c63f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:25.972358 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8495da33-6829-4166-806a-6dd37b3be6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:25.984495 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1461/2895] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 28 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:25.992286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff2fa-8a55-4e66-a5d4-5e466001211b service swift] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:26.004636 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff2fa-8a55-4e66-a5d4-5e466001211b service swift] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:26.010112 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f604a-f99b-45fe-8f1f-6509aa6aa14a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38bd83f5a0bc4e7ea5cde1972c44503b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:26.010716 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f604a-f99b-45fe-8f1f-6509aa6aa14a service swift] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:26.010998 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f604a-f99b-45fe-8f1f-6509aa6aa14a service swift] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:26.011274 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f604a-f99b-45fe-8f1f-6509aa6aa14a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:26.020176 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f604a-f99b-45fe-8f1f-6509aa6aa14a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:26.021786 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f604a-f99b-45fe-8f1f-6509aa6aa14a service swift] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:26.030363 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1435/2896] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 28 18:17:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 18:17:28.653613 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495da33-6829-4166-806a-6dd37b3be6e6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:28.655047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8495da33-6829-4166-806a-6dd37b3be6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:28.722193 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495da33-6829-4166-806a-6dd37b3be6e6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:28.727019 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:28.727660 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:28.728897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:28.728897 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] PATH_INFO: `/v3/users/2634a93ff3b04bbab9fb4ba3af106a98` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:28.729410 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2634a93ff3b04bbab9fb4ba3af106a98)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:28.731905 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:28.918218 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2634a93ff3b04bbab9fb4ba3af106a98'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:28.919399 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2634a93ff3b04bbab9fb4ba3af106a98'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:28.926534 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2634a93ff3b04bbab9fb4ba3af106a98'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:28.927224 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2634a93ff3b04bbab9fb4ba3af106a98'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:28.939850 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2634a93ff3b04bbab9fb4ba3af106a98'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:29.080079 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:29.086983 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1462/2897] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:28 2022] DELETE /identity/v3/users/2634a93ff3b04bbab9fb4ba3af106a98 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:29.092263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bb155-4735-4719-bcf3-1b6a965c93dd None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:29.092931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bb155-4735-4719-bcf3-1b6a965c93dd None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:29.092931 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bb155-4735-4719-bcf3-1b6a965c93dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:29.115471 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-e69bb155-4735-4719-bcf3-1b6a965c93dd None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:29.120224 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e69bb155-4735-4719-bcf3-1b6a965c93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:29.179923 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1436/2898] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:29.189952 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:29.191444 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:29.257555 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5358507-0749-45bb-af24-b9139ca75f70 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:29.261366 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bced4-0a4f-4824-bcfc-000b88f6597e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:29.261977 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bced4-0a4f-4824-bcfc-000b88f6597e service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:29.262258 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bced4-0a4f-4824-bcfc-000b88f6597e service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:29.262532 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bced4-0a4f-4824-bcfc-000b88f6597e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:29.273045 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bced4-0a4f-4824-bcfc-000b88f6597e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:29.274475 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bced4-0a4f-4824-bcfc-000b88f6597e service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:29.285088 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1463/2899] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:29.532657 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bb155-4735-4719-bcf3-1b6a965c93dd None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:29.534092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e69bb155-4735-4719-bcf3-1b6a965c93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:29.556000 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bb155-4735-4719-bcf3-1b6a965c93dd None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:29.561784 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:29.563157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:29.563157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:29.563157 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] PATH_INFO: `/v3/projects/88ffef3f582c4832bc7caffc43373cc7` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:29.564377 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ffef3f582c4832bc7caffc43373cc7)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:29.566315 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:29.759658 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ffef3f582c4832bc7caffc43373cc7', 'request_id': 'req-1877ab05-35d9-48c1-be60-69cea4176512'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:29.765882 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ffef3f582c4832bc7caffc43373cc7', 'request_id': 'req-1877ab05-35d9-48c1-be60-69cea4176512'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:29.867386 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ffef3f582c4832bc7caffc43373cc7', 'request_id': 'req-1877ab05-35d9-48c1-be60-69cea4176512'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:29.879909 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] The token cache is being invalidate because project 88ffef3f582c4832bc7caffc43373cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:29.880201 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:29.880894 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-1877ab05-35d9-48c1-be60-69cea4176512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:29.882400 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1437/2900] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:29 2022] DELETE /identity/v3/projects/88ffef3f582c4832bc7caffc43373cc7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:39.280476 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=27 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:39.875986 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:41.356251 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bced4-0a4f-4824-bcfc-000b88f6597e service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:41.357680 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-985bced4-0a4f-4824-bcfc-000b88f6597e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:41.370832 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bced4-0a4f-4824-bcfc-000b88f6597e service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:41.424980 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:41.425610 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:41.425892 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:41.426165 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] PATH_INFO: `/v3/users/33f30a97306b4a81a9790dbb27df736d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:41.427328 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f30a97306b4a81a9790dbb27df736d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:41.429273 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:41.652226 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f30a97306b4a81a9790dbb27df736d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:41.652954 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f30a97306b4a81a9790dbb27df736d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:41.660321 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f30a97306b4a81a9790dbb27df736d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:41.660992 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f30a97306b4a81a9790dbb27df736d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:41.673125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f30a97306b4a81a9790dbb27df736d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:41.781617 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1464/2901] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:17:41 2022] DELETE /identity/v3/users/33f30a97306b4a81a9790dbb27df736d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:41.786079 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207f4d9-38bd-4745-901e-6abd2168086a None None] REQUEST_METHOD: `POST` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:41.786587 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207f4d9-38bd-4745-901e-6abd2168086a None None] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:41.786688 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207f4d9-38bd-4745-901e-6abd2168086a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:41.805692 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.auth.core [None req-a207f4d9-38bd-4745-901e-6abd2168086a None None] MFA Rules not processed for user `c4cff41da8b84a87883a6878ed4555c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 18:17:41.806906 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a207f4d9-38bd-4745-901e-6abd2168086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:41.865398 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1438/2902] 10.222.0.67 () {58 vars in 958 bytes} [Thu Jul 28 18:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 18:17:41.875115 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:41.877084 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:41.933845 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922563c-70ac-4347-81ee-51d2094dc4ed admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:41.937537 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66229e-61ae-429a-857c-a0ad4c134c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:41.938648 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66229e-61ae-429a-857c-a0ad4c134c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:41.939076 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66229e-61ae-429a-857c-a0ad4c134c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:41.939349 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66229e-61ae-429a-857c-a0ad4c134c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:41.948334 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66229e-61ae-429a-857c-a0ad4c134c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:41.949773 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66229e-61ae-429a-857c-a0ad4c134c06 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:41.959605 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1465/2903] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:17:42.320331 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207f4d9-38bd-4745-901e-6abd2168086a None None] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:17:42.321761 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-a207f4d9-38bd-4745-901e-6abd2168086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:17:42.334506 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207f4d9-38bd-4745-901e-6abd2168086a None None] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:17:42.339207 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:17:42.339899 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:17:42.340167 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:17:42.340439 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] PATH_INFO: `/v3/projects/362b2aece2dd4d078d31595168daebdd` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:17:42.341648 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=362b2aece2dd4d078d31595168daebdd)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:17:42.343609 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:17:42.513402 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362b2aece2dd4d078d31595168daebdd', 'request_id': 'req-6fd0856b-ea06-4316-88f6-32ae6915b03f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:42.519667 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362b2aece2dd4d078d31595168daebdd', 'request_id': 'req-6fd0856b-ea06-4316-88f6-32ae6915b03f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:42.587074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362b2aece2dd4d078d31595168daebdd', 'request_id': 'req-6fd0856b-ea06-4316-88f6-32ae6915b03f'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:42.598466 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] The token cache is being invalidate because project 362b2aece2dd4d078d31595168daebdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:17:42.598752 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:42.599457 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:17:42.601074 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1439/2904] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:17:42 2022] DELETE /identity/v3/projects/362b2aece2dd4d078d31595168daebdd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:17:51.955370 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:52.595549 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:32.986174 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66229e-61ae-429a-857c-a0ad4c134c06 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:32.987707 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6d66229e-61ae-429a-857c-a0ad4c134c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:32.999675 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66229e-61ae-429a-857c-a0ad4c134c06 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:33.050145 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2eb1f-8951-447e-b345-70fa1fb06dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:33.050768 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2eb1f-8951-447e-b345-70fa1fb06dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:33.051047 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2eb1f-8951-447e-b345-70fa1fb06dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:33.051313 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2eb1f-8951-447e-b345-70fa1fb06dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:33.053125 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3cd2eb1f-8951-447e-b345-70fa1fb06dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:33.063372 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2eb1f-8951-447e-b345-70fa1fb06dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:33.064810 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2eb1f-8951-447e-b345-70fa1fb06dd6 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:33.073700 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1466/2905] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:19:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 18:19:33.391480 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:33.392815 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:33.405358 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0856b-ea06-4316-88f6-32ae6915b03f admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:33.409594 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:33.410200 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:33.410481 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:33.410762 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:33.412520 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:33.487768 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:33.489254 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:33.501306 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1440/2906] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:19:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:19:34.682559 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2eb1f-8951-447e-b345-70fa1fb06dd6 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:34.691433 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2eb1f-8951-447e-b345-70fa1fb06dd6 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:34.695661 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0116171a83f5444d91ce0ea2439a9bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:34.696275 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:34.696557 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:34.696861 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:34.698615 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:34.713134 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:34.714539 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:34.727631 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1467/2907] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:19:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:19:41.990111 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:41.992067 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:42.073082 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a87af5-efcc-47ce-bffb-9edb08404f00 service neutron] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:42.078092 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d4c1-279c-4668-8353-a7eb01ac2d36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:42.078707 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d4c1-279c-4668-8353-a7eb01ac2d36 service placement] REQUEST_METHOD: `GET` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:42.078994 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d4c1-279c-4668-8353-a7eb01ac2d36 service placement] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:42.079270 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d4c1-279c-4668-8353-a7eb01ac2d36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:42.081183 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-e694d4c1-279c-4668-8353-a7eb01ac2d36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:42.092823 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694d4c1-279c-4668-8353-a7eb01ac2d36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:42.094387 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694d4c1-279c-4668-8353-a7eb01ac2d36 service placement] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:42.105037 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1441/2908] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:19:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:19:44.720732 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=32 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:45.912651 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:45.914749 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:45.981903 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ddede-dfbb-42df-8bf4-0e24cb115b63 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:45.987760 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:45.988398 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:45.988683 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:45.988986 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] PATH_INFO: `/v3/users/3ac845392b3342e1b71a3b8aaad851e2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:45.992646 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac845392b3342e1b71a3b8aaad851e2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:45.994608 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:46.189898 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac845392b3342e1b71a3b8aaad851e2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.190551 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac845392b3342e1b71a3b8aaad851e2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.198116 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac845392b3342e1b71a3b8aaad851e2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.198637 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac845392b3342e1b71a3b8aaad851e2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.211961 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac845392b3342e1b71a3b8aaad851e2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.307232 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1468/2909] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:19:45 2022] DELETE /identity/v3/users/3ac845392b3342e1b71a3b8aaad851e2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:19:46.550977 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d4c1-279c-4668-8353-a7eb01ac2d36 service placement] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:46.561776 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d4c1-279c-4668-8353-a7eb01ac2d36 service placement] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:46.621888 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:46.622535 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:46.622862 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:46.623137 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] PATH_INFO: `/v3/projects/dd8e9c069b8141bfa2d5383b0890bc76` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:46.624286 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8e9c069b8141bfa2d5383b0890bc76)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:46.626212 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:46.642968 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=100 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:46.749788 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8e9c069b8141bfa2d5383b0890bc76', 'request_id': 'req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.755170 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8e9c069b8141bfa2d5383b0890bc76', 'request_id': 'req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.841084 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8e9c069b8141bfa2d5383b0890bc76', 'request_id': 'req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.852976 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] The token cache is being invalidate because project dd8e9c069b8141bfa2d5383b0890bc76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:19:46.853263 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.853877 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:46.855374 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1442/2910] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:19:46 2022] DELETE /identity/v3/projects/dd8e9c069b8141bfa2d5383b0890bc76 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:19:46.859375 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:46.860801 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:46.874391 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e1bb4-94be-4082-9a7f-b6f267e69ee0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:46.930363 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:46.930973 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:46.931253 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:46.931530 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] PATH_INFO: `/v3/users/4e80eedec4424f7c99694b3a788e8415` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:46.932701 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e80eedec4424f7c99694b3a788e8415)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:46.934654 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:46.955541 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:47.117282 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e80eedec4424f7c99694b3a788e8415'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.117872 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e80eedec4424f7c99694b3a788e8415'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.124548 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e80eedec4424f7c99694b3a788e8415'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.125200 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e80eedec4424f7c99694b3a788e8415'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.137440 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e80eedec4424f7c99694b3a788e8415'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.201150 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1469/2911] 10.222.0.67 () {58 vars in 1224 bytes} [Thu Jul 28 18:19:46 2022] DELETE /identity/v3/users/4e80eedec4424f7c99694b3a788e8415 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:19:47.462721 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] Authenticating user token {{(pid=80525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:19:47.466533 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.fernet_utils [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:19:47.478141 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc3c8-05b7-4980-a88b-3fd17a20478e admin admin] Validating token access rules against request {{(pid=80525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:19:47.534017 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4cff41da8b84a87883a6878ed4555c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a97b72a2b1b942bf9e2176dec834c175', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:19:47.534639 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:19:47.534915 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:19:47.535185 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] PATH_INFO: `/v3/projects/a838fb25b3274a8988182ed0e3984702` {{(pid=80525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:19:47.536312 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a838fb25b3274a8988182ed0e3984702)` {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:19:47.538775 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] RBAC: Authorization granted {{(pid=80525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:19:47.676135 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a838fb25b3274a8988182ed0e3984702', 'request_id': 'req-7f0380df-703f-48a3-a5cb-95e920d5b0f5'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.682252 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a838fb25b3274a8988182ed0e3984702', 'request_id': 'req-7f0380df-703f-48a3-a5cb-95e920d5b0f5'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.746305 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a838fb25b3274a8988182ed0e3984702', 'request_id': 'req-7f0380df-703f-48a3-a5cb-95e920d5b0f5'} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.757541 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] The token cache is being invalidate because project a838fb25b3274a8988182ed0e3984702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 18:19:47.757829 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.758474 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG keystone.notifications [None req-7f0380df-703f-48a3-a5cb-95e920d5b0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 18:19:47.759987 dv-cinder-846173-4-smb devstack@keystone.service[80525]: [pid: 80525|app: 0|req: 1443/2912] 10.222.0.67 () {58 vars in 1233 bytes} [Thu Jul 28 18:19:47 2022] DELETE /identity/v3/projects/a838fb25b3274a8988182ed0e3984702 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 18:19:57.197394 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:57.754597 dv-cinder-846173-4-smb devstack@keystone.service[80525]: DEBUG dbcounter [-] [80525] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:41.106650 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 18:22:41.108097 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:22:41.181271 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50373724-4b83-4672-938b-40fd77014b29 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 18:22:41.240119 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f100bf-1c9e-4a99-a195-99846c61a66c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dded05b23a0469785e3a7bedf1cf851', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b54ffabf97d94349a57743c716eaed0b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 18:22:41.240736 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f100bf-1c9e-4a99-a195-99846c61a66c service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 18:22:41.241050 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f100bf-1c9e-4a99-a195-99846c61a66c service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 18:22:41.241327 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f100bf-1c9e-4a99-a195-99846c61a66c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 18:22:41.243077 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c2f100bf-1c9e-4a99-a195-99846c61a66c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 18:22:41.254159 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f100bf-1c9e-4a99-a195-99846c61a66c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 18:22:41.255716 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f100bf-1c9e-4a99-a195-99846c61a66c service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 18:22:41.265527 dv-cinder-846173-4-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1470/2913] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 28 18:22:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 18:22:51.261325 dv-cinder-846173-4-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=58 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}